Posts Tagged: Chatbots

May 31, 2021

Catching chatbots by the long tail

This blog was originally posted at Xebia.com, my employer at the time of writing.

Have you ever had a conversation with a chatbot? Was it a positive experience? It might have been. But more likely than not it left you a bit frustrated. Chatbots try to understand your message and help you with an appropriate response. However, most of the time they're not that great yet. In a way chatbots are like baseball players.

"Baseball is the only field of endeavor where a man can succeed three times out of ten and be considered a good performer." — Ted Williams, baseball Hall of Famer

The same holds true for chatbots. A deflection percentage of 32% [users helped by the bot without human intervention] is what google considers a success story!

Customer Story on Google Dialogflow's website. Retrieved 20 April 2021

As a data science consultant I've worked with multiple companies on chatbots and helped them do better. During these projects I have discovered a pattern that might help others build better chatbots too. In this article I outline three tips that should help you focus on what matters.

Catching chatbots by the long tail

Shell sage is an amazing tool that lets you chat with an LLM inside your terminal. It automatically loads in your shell history into the context window so the LLM knows what you've been doing. Combine with with Ipython and you've got an interactive python environment to pair in with the LLM. Add ipdb and you've got an AI enabled debugger.