Chatbot Accessibility Playbook

Recommendation 4.2.15:
Let the user know what commands they can use and when they can use them

Benefits Users

Icon for CognitiveCognitive

Icon for StandardRelevant W3C Guidance


Phase 1: Gather & Organize

Icon for User ResearchUser Research

  • Learn about the essential workflows that users want to follow and design the list of commands to support that. Ask members of the target user group to sort chatbot capabilities into “critical”, “useful”, and “other”. Do the commands use language the users understand?


Phase 2: Design & Implement

Icon for Design QuestionDesign Question

  • Will your chatbot support free text inputs?

    • Free text allows more natural conversational styles and lets the user approach the task in an intuitive way. If you offer a free text input, you will need to let the user know what they can ask the chatbot. If you don’t offer a free text input, disable the text input box so users know they have to select one of the offered choices to each question.

Icon for TipTip

  • If the list of acceptable commands changes throughout the conversation, make sure your supporting documentation (or the “help” option) updates accordingly.

Icon for ExamplesExamples

  • List 2-4 high-level commands with a list of related sub-tasks underneath: “File a claim (create a new small business or individual claim), View an existing claim (edit, close, or check the status of the claim), or Learn about claims (learn about types of claims supported by this office, determine your eligibility, and read about reimbursement methods)”

  • Propose 2-3 of the most common tasks and offer more if the user needs them: “You can file a claim or look up an existing claim. For a complete list of activities I can do for you, select ‘Chatbot Help’”.

  • Offer an (accessible) page with a full list of commands

  • Offer an option to “see all available commands”.


Phase 3: Test & Evaluate

Icon for Self CheckSelf Check

  • The user has access to a list of valid commands or requests

  • The chatbot suggests valid queries/commands if the input is active but empty for a while.

  • Chatbots capable of voice interaction (accessibly) describe how to activate that feature

Icon for Ask the UserAsk the User

  • Did you know how to start the task you wanted to accomplish?

    • This question is subjective; use a Likert scale. This question should be asked post-study.
  • Does the chatbot offer helpful conversation suggestions when you don’t know what to say?

    • This question is subjective; use a Likert scale. This question should be asked post-study.



References

16, 19, 23, 28