Test the NLU classification of intents and slots

The built-in Natural Language Understanding (NLU) evaluation tool enables you to test sample messages against existing intents and dialog acts.

Dialog acts are intents that identify the purpose of customer utterances. The NLU service categorizes dialog acts by escalation, affirmation, negation, and reset. The following examples describe possible utterances for each category:

  • Escalation indicates that the customer wants to speak to a human representative. For example, agent, person, live person, manager, assistance.
  • Affirmation indicates that the customer confirms the previous bot response. For example, yes, yeah, yep, correct.
  • Negation indicates that the customer denies the previous bot response. For example, no, nope, incorrect.
  • Reset indicates that the customer did not understand the previous bot response. For example, say that again, repeat that please, what?

When you enter a sample message or phrase for testing, the NLU service returns the probability of an intent or dialog act match.

This image illustrates the probabilities of the utterance, “I want to speak to a live person about my loan” to potential Loan, Agent, Find a Branch, None, and Check Account Balance intents and also the probability of a matching escalation dialog act.

Click the image to enlarge.

Test NLU dialog box

Use the Test NLU tool

To evaluate a sample message, follow these steps:

  1. From the Intents, Slots, Slot Types, Utterance History, or Learning view, click Test NLU. The NLU test dialog opens.
  2. In the Type message here box, enter your sample phrase or message.
  3. Press Enter.

The NLU test dialog returns probability scores for the phrase or message.