As we know python is not multi-threaded so entity extraction for a huge dataset containing 2.2k entities is taking almost 10 hours of training time. I am currently experimenting with multi-threading, multi-processing & overcoming GIL concepts. But so far no luck. Anyone here can help me with making CRFEntityExtractor into multi-threaded system ?
Any suggestion is appreciated. Thank you.