Authentic Communication in VR

Building a Dialogue System to Allow Users to Build Communication Skills

Business Challenge:
The dialogue systems used in VR products often involve excessive text, often do not offer users options, and fail to represent an authentic conversation.

Hypothesis:
Allowing users to express the appropriate sentiment and physically speak the words will better represent the processing that takes place in a conversation and will allow users to physically practice speaking skills.

Design Approaches:
⦾ The users should submit answers via speech input
⦾ The experience must operate fully offline
⦾ The user should be empowered to make choices and be able to express different emotions
⦾ The dialogue should be responsive, but continue to progress the storyline in a similar manner

Competitor Research for Soft Skills Training

Compiled information on related competitor products for soft skill and employability training

Rapid Storyboard Solutions

Rapid one-to-three panel storyboards for potential dialogue solutions and features

Complete Visual Outline of User Experience

Flowchart of events, interactions, and dialogue for communication soft skill training prototype tutorial and experience

Yarn Spinner Code for Dialogue and Logic

Segment of Yarn Spinner code written to allow proper flow and navigation of dialogue for experience; also contains logic for conditional responses

Playthrough of Second Iteration of Experience

Playthrough of the second iteration experience in Meta Quest 2 headset

Segment of User Test Interview

Interview segment following the first user test session of first prototype iteration