Comparing the performance of GPT-3 and Rasa on a simple use case

I recently got access to the GPT-3 beta and I took advantage of the opportunity to test it head-to-head against a simple Rasa chatbot I implemented earlier this year. You can see the results of the comparison, plus some reflections on what GPT-3 means for us, here:

1 Like

Happy to read people have had similar experiences with GPT-3. My main concern with GPT-3 is the bigotry that it tends to generate though. I’ve noticed that just mentioning a country can lead the generated text to suddenly become somewhat stereotypical.