I’m looking for some architectural/guidance. I’m trying to now, pay around with some of the text-generation NLP models, like GPT-2. What I’d like to do, is allow a user to say a phrase, and generate some short text based on the the phrase, basically, recreate gpt2 · Hugging Face for myself with Rasa.
I think I have to do this with custom actions, because my understanding is that the pipelines in Rasa, only help improve understanding of what the user says. But should I be creating a formAction to use/access a model? For example, instead of
from transformers import pipeline in my action.py, is there a way to call the model in my config file and use it in my action.py?
- name: HFTransformersNLP model_name: "gpt2" model_weights: "gpt2"
I’m not sure if I’m thinking about this correctly, so asking here. Apologies if this is confusing.