Hi, I am trying to build a clothing recommender system using CLIP transformer model(by Open AI) as CLIP works with multimodal data(text and image) and tells us how close the ‘embedding of a text’ is to the ‘embedding of an image’. Therefore I want to take the responses of my users from my rasa bot and get the closest image recommendation from CLIP model. My question: How I do integrate CLIP model with my rasa bot. Please help me, thank you!

How can I use CLIP model(by Open AI) in my rasa project

stephens (Greg Stephens) January 12, 2023, 4:22pm 2

I’m not familiar with CLIP but you can create a custom component. I posted about it recently here.

Topic		Replies	Views
Integration of GPT model with Rasa 3.1 Rasa Open Source	0	265	July 24, 2023
Integrate RASA model into streamlit chatbot Rasa Open Source	1	237	March 1, 2024
What are the community's suggestions on incorporating open-domain models? Rasa Open Source	0	211	July 30, 2021
Is it possible to integrate Rasa with Keras framework model (deep learning or machine learning chatbot)? Community Groups & Events	0	922	March 12, 2021
Using BERT for Q&A in RASA Rasa Open Source	2	454	May 5, 2021