AR-Mentor: Augmented Reality Based Mentoring System
SCHEDULE INFORMATION
Event Title
Session Title
Chair
Room
Start
End
Applications
Applications
Dieter Schmalstieg, TU Graz
HS1
10 Sep, 2014 02:15 PM
10 Sep, 2014 03:45 PM
Authors:
Zhiwei Zhu
Authors:
Vlad Branzoi
Authors:
Michael Wolverton
Authors:
Louise Yarnall
Authors:
Girish Acharya
Authors:
Supun Samarasekera
Authors:
Rakesh Kumar
Authors:
Glen Murray
Authors:
Nicholas Vitovitch
Abstract:
AR-Mentor is a wearable real time Augmented Reality (AR) mentoring system
that is configured to assist in maintenance and repair tasks of complex
machinery, such as vehicles, appliances, and industrial machinery. The system
combines a wearable Optical-See-Through (OST) display device with high
precision 6-Degree-Of-Freedom (DOF) pose tracking and a virtual personal
assistant (VPA) with natural language, verbal conversational interaction,
providing guidance to the user in the form of visual, audio and locational
cues. The system is designed to be heads-up and hands-free allowing the user
to freely move about the maintenance or training environment and receive
globally aligned and context aware visual and audio instructions (animations,
symbolic icons, text, multimedia content, speech). The user can interact with
the system, ask questions and get clarifications and specific guidance for
the task at hand. A pilot application with AR-Mentor was successfully
developed to instruct a novice to perform an advanced 33-step maintenance
task on a training vehicle. The initial live training tests demonstrate that
AR-Mentor is able to help and serve as an assistant to an instructor, freeing
him or her to cover more students and to focus on higher-order teaching.