Is there any way to put a NLU Threshold while running rasa nlu test?
Same question ! I want to self-implement but how to calculate precision, recall, f1 when there are some samples have confidences less than a fixed threshold ?
this isn’t possible currently, but would be a nice PR if you wanted to work on it! If so, please create an issue so we can discuss the implementation beforehand
I have had same requirement recently and have included a custom logic in the test flow locally. Can I create a PR for this job? Or is this already taken up and going to get fixed?
not to my knowledge! Exciting that you’re keen to contribute. Do please create an issue with a description of the idea before starting work so we can be aligned on the scope and goals.