AI Services
Chatbot Audit
Your support chatbot is about to talk to customers in your name. The questions that matter most are the ones your documents do not answer. A bot that invents a refund policy, a price, or a warranty does more harm than one that says it does not know, and customers will hold you to what it said. Most of the audit is aimed at that failure.
The checks are rules wherever a rule can decide. Where only judgment can tell whether an answer is wrong, an AI model looks for contradictions with your documents, quotes the exact line it relied on, and is labeled as a model's verdict so you can check it yourself. Anything the checks cannot settle is listed for a person to read and is never counted as a pass.
How it works
Write the questions
We build about 60 questions from your documents: ones they answer, ones close to them that they do not, policies you do not have, requests outside the bot's job, attempts to make it break its rules, and questions about one customer's own order. You approve the list before anything is sent to your bot.
Check every answer
Questions go to your bot one at a time, some as short conversations, because a bot that is fine with one message can be talked round over three. Every price, percentage, number of days, date, phone number, email address, and link in its replies is compared with your documents. If it is not there, we flag it.
Rank what to fix
You get one report that opens in any browser and prints cleanly: the pass and fail counts, the three most serious failures in plain words, then every question with the bot's exact reply and the reason for its verdict. A short call or written note covers what to fix first.
What you get
- A report of every question with the bot's exact reply
- The three most serious failures, explained in plain words at the top of the report
- The question set, so you can run the same test again after every change you make
- A short call or written note on what to fix first, and in what order to fix it
Common questions
What does it cost?
$295 for a 30-question check in 3 days, $650 for the full 60-question audit in 5 days, and $950 for the full audit plus a retest after your fixes, delivered within 14 days including the time you take to make them. Fixing the bot is separate work, quoted once you have seen the report.
What do you need?
The documents the bot is meant to answer from, such as policies, shipping and returns, product facts, and contact details. A way to reach the bot, either the address it answers on or the web page its chat window is on. And written confirmation that you own the bot or are allowed to have it tested.
Is it a security test?
No. It includes a basic set of attempts to make the bot break its rules, but it is not a security or penetration test, and it is not a load test. Questions are sent one at a time with a pause between them.
Is a pass a guarantee?
No. A pass is one good answer, not a promise. Each question is asked once, and a bot can answer differently next time. The question set is yours to keep, so you can run it again after every change.