Dear Rasa Team,
I initially submitted my request through the “Talk with Sales” form this Monday and followed up with an email on Wednesday, but I have not yet received a response. My inquiry concerns licensing and support for a proof of concept (POC) setup using the Rasa Platform. We aim to develop a chatbot to enhance customer inquiries on our website. Here are the key details:
About Us:
We are a leading provider of full-time tertiary education in Hong Kong, serving approximately 12,000 students in the 2022/23 academic year. Our goal is to implement a chatbot that provides efficient and effective support to our current and prospective students.
Anticipated Use Cases for the Chatbot:
- Admissions: The AI-powered chatbot will assist applicants by answering questions related to program information, application guidelines, and website navigation based on internal documents.
- Student Support: The chatbot will offer responses to student inquiries, including links to online forms, the academic calendar, and other relevant resources.
Expected Workload Requirements:
- Concurrent Users: 20
- Throughput: 20 tokens per second
- LLM Selection: Dependent on test results
- Expected Hardware: A shared server with Nvidia H20 x 8 and 768GB VRAM
We would appreciate your guidance on the following:
- Licensing: Which licensing plan would be most suitable for our POC setup? We would like to understand the costs and benefits associated with each option.
- Capacity Planning: What are the minimum requirements for our expected workload? Are there any scalability concerns we should consider to ensure our infrastructure can support the chatbot’s growth?
- Integration with Human Agents: Is it possible to integrate the chatbot with real-time human assistance? Specifically, we would like the option for the chatbot to escalate queries to a human agent if it cannot provide answers during office hours. What are the requirements for implementing this feature with the Rasa Platform?
Please let me know if you need any further information. Thank you for your assistance, and I look forward to your response.
Regards,
Kris