Testing Conversational AI Chatbots - What automation tools are there?

Does anyone have any experience with testing chatbots (web messaging bots) using automation tools?

I have come across Botium and will be doing some research into this, but is anyone aware of any other automation framework tools out there? I am especially interested in any free opensource tools, but am open to any ideas and suggestions you may have.

I look forward to hearing about any experience you have had either using the tools or from any research you may have done.

@philippa Any luck? I am on the same boat and wanted to gain insights from anyone who has had expereince and set up processes tools around chatbot testing

Have u tried using playwright for automating chatbot

I’ve had decent results pairing Botium tests with channel-specific APIs. For WhatsApp flows, I plugged my bot into the whatsapp business api, which let me script message exchanges with simple HTTP calls and keep the test setup lightweight. For open-source options, I’ve also used a mix of Postman collections plus a small Node script to mock intents and validate responses without needing a full UI harness.