Skip to main content
. Author manuscript; available in PMC: 2018 Aug 17.
Published in final edited form as: Digit Cult Educ. 2018 Jul 13;10:22–48.

Table 5.

Iterative improvement of the Tough Talks AI system as applied to a test set of 26 participant dialogues from Phase 2 usability sessions

Disclosure Scenario
Row Neutral Negative Positive
1 Average percentage of AI suggested virtual character utterances selected by wizard using original dialogue manager 25% 17% 17%
2 Average percentage of AI suggested virtual character utterances coded as “acceptable” using refined dialogue manager including dialogue policy 54% 51% 49%
3 Average percentage of AI suggested virtual character utterances coded as “acceptable” using further refined dialogue manager (re-annotation and disclosure analysis) 84% 80% 71%