Test your assistant before customers do
Run automatic or custom question tests, review pass or fail results, and check tone and security behavior of your AI assistant.
Assistant tests let you check answers, keep useful questions, and re-run them after every change.
Before you start
- Save your assistant first. Otherwise you see "Save your assistant settings first."
- Tests use your saved assistant configuration. Changes to settings or sources during a run require a new run.
How tests answer
Question tests, Auto test, and Conversation & security tests use the same assistant answer process, with your saved model, instructions, enabled tools and Security Guard settings. AI grading runs separately from answer generation.
Document search follows your assistant's retrieval settings: it can look up relevant passages automatically and search again when the assistant requests more information. Only documents available to your assistant can appear in results. Read-only tools can look up authorized information from your company, such as products, services and public contact details.
Test actions and privacy
Actions such as collecting a lead, submitting or updating an order, requesting human help and starting a flow are simulated in isolated test state. They do not change real customer records, send notifications or start real automations. Generated checkout links are test links, not usable purchase links. Tests do not load real customer leads, orders or bookings into their simulated customer state.
In conversation tests, simulated changes carry across messages within the same test conversation. Separate test conversations start with separate state.
Test conversations stay out of the Inbox and do not send messages to customers. Temporary processing state is cleaned up after each turn, and retry data expires automatically after 15 minutes. Your saved answers, sources, conversation transcripts and reviews remain in test history.
Open it
Web: sidebar > Assistant > Assistant tests, or Test assistant from the assistant page. After saving the assistant, Try your assistant now offers an automatic test.
Auto test (one click)
Auto test reuses up to 50 current questions, or lets AI create 10 if you have none, then answers them and reviews the answers automatically. It shows progress: Preparing questions, Running tests, AI is reviewing answers, Completed. Open View results when it finishes.
If any criteria were not yet approved, the result is marked Unapproved criteria: treat it as provisional.
Your own questions
- Add question, or Redesign questions with AI to get drafts (up to 20 per run, in English, Persian, Turkish, Arabic or Spanish).
- Drafts need approval: set the Expected answer / criteria, then Approve question (or Approve all).
- Select approved questions (up to 50) and choose Run tests.
- Read each result: Assistant answer, Retrieved sources, and the AI review with a verdict of Pass or Fail. Items the AI is unsure about show Needs human review.
- To override the verdict, choose Admin review, pick the verdict and add an optional note.
Question statuses are Draft, Approved and Needs review (shown when related information changed; review the criteria and approve again). Use Archive to retire a question while keeping its past results.
Each run keeps its question revisions, assistant settings, source versions and answers. The latest 20 runs are listed in Run history.
Conversation and security tests
Conversation & security tests check tone, brevity, greetings, natural replies, memory, and security behavior: staying within business scope and resisting prompt injection. You can try alternative Style instructions for a run without changing your live assistant, and compare Before and After results.
Tips
- Add questions customers really ask, especially prices, policies and "what if" cases.
- Re-run after changing your assistant settings, knowledge documents or services.
- A "Retrieval review" shows whether the assistant found the right document passage.
Troubleshooting
- "Assistant or sources changed during processing": start a new run or redesign.
- "The test could not complete": check your assistant is saved, then start a new run.
- A run is marked "Sources changed": its results used earlier information. Run the same questions again.
Limitations
- Each message uses your assistant model, and each conversation has a separate AI review, so large runs take time. Test creation is rate limited.
- A successful simulated action checks assistant behavior; it does not confirm a real payment, booking, notification or automation.
- These tests do not complete the public booking form or a real checkout.
- Not available as a dedicated screen in the mobile app.
Last updated on
Choose which customer details your assistant collects
Select the lead fields (name, email, phone and more) your assistant asks for, and add custom fields such as budget or date.
Upload documents your assistant can use
Upload PDF, DOCX, TXT, Markdown and CSV files so your assistant can answer from them, and manage their status.