How to add user_dict in SpacyTokenizer

[mashagua]

how to add dictionary_path: “path/to/custom/dictionary/dir” in SpacyTokenizer like in JiebaTokenizer?

[erohmensing (Ella Rohm-Ensing)]

Hello,

I don’t believe this is possible with the SpacyTokenizer. However, since the SpacyTokenizer requires SpacyNLP and an associated model, you could provide a model you’ve self trained to include those words from your custom dictionary.

[mashagua]

ok, I think so,thank you