Presentation Title

Augmented Reality Travel Assistant (ARTA)

Faculty Mentor

Hong-Chuan Lin, Zhen Yu, Xudong Jia

Start Date

18-11-2017 2:15 PM

End Date

18-11-2017 2:30 PM

Location

9-245

Session

Engineering/CS 2

Type of Presentation

Oral Talk

Subject Area

engineering_computer_science

Abstract

The advent of the smartphone introduced the first step in portable computing devices. The goal of the Augmented Reality Travel Assistant (ARTA) project was to demonstrate that Augmented Reality (AR) can be more useful than a simple smartphone game like Pokemon Go, but rather technology’s next step in portable computing devices. ARTA, a portable Travel Assistant, tackles both the logistical and social aspects of travel inside a wearable headset. The AR headset overlays situational relevant data to the user in real-time. The Software System Design contains three features: A Mobile Traffic System Application (MTSA) – helping to anticipate traffic light patterns; Surrounding Emotional Analysis System – to evaluate attitudes and feelings of surrounding pedestrians and an Audio/Visual Linguistic Translation System – to translate foreign language in both traffic signs and spoken conversations. Finally, implementing an augmented reality system, the processed data is displayed before the wearer of the ARTA headset.

Summary of research results to be presented

The traffic light pattern app was able to find the user’s GPS coordinates and track accurately. However due to the need of translating from android to amazon web services to MCCAIN INC’s C# language further expansion is needed to fulfill its goal. The audio translator proved effective and useful in one and one conversations. However, in large crowded environments with surrounding white noise, proved difficult for the translator to hear speech. As for the AR translator, Processing had to be completed independently of the headset itself and an effective wireless network had to be created. The constant encoding, decoding, and flattening of data to be sent over the network gave rise to latency and lag in the AR program and made the headset tether to a 90 yard range of the PC. This senior design project showed that there is still a way to go to implement a fully independent portable wearable AR system. Dedicated processors for image processing like ones found in Microsoft’s Hololens, called a Virtual Processing Unit (VPU) are necessary to produce a fully independent system. And concepts like a wearable audio translator that translate what you speak, word by word in proper order, as well as an accurate Traffic light display are still but an idea of science fiction. This project was successful in arguing the need for Augmented Reality. And with more advanced embedded hardware. It could replace the smartphone as the next portable powerful computing device.

This document is currently not available here.

Share

COinS
 
Nov 18th, 2:15 PM Nov 18th, 2:30 PM

Augmented Reality Travel Assistant (ARTA)

9-245

The advent of the smartphone introduced the first step in portable computing devices. The goal of the Augmented Reality Travel Assistant (ARTA) project was to demonstrate that Augmented Reality (AR) can be more useful than a simple smartphone game like Pokemon Go, but rather technology’s next step in portable computing devices. ARTA, a portable Travel Assistant, tackles both the logistical and social aspects of travel inside a wearable headset. The AR headset overlays situational relevant data to the user in real-time. The Software System Design contains three features: A Mobile Traffic System Application (MTSA) – helping to anticipate traffic light patterns; Surrounding Emotional Analysis System – to evaluate attitudes and feelings of surrounding pedestrians and an Audio/Visual Linguistic Translation System – to translate foreign language in both traffic signs and spoken conversations. Finally, implementing an augmented reality system, the processed data is displayed before the wearer of the ARTA headset.