Thanks for introducing the feature called Entity Roles and Groups. it has been great addition!
I have noticed that Entity roles are extracted along with their BILOU tags from CRFEntityExtractor, which is causing an issue during test/cross validation phase. So all the role based entities have 0 accuracy metric scores always.
Hope this can be solved by removing BILOU tags and combining multiple tokens within the entity value.
here are my data files: