MARVEL: Enabling Mobile Augmented Reality With Low Energy And Low Latency

Authors:
Kaifei Chen UC Berkeley
Tong Li UC Berkeley
Hyung-Sin Kim UC Berkeley
David Culler UC Berkeley
Randy Katz UC Berkeley

Introduction:

This paper presents MARVEL, a mobile augmented reality (MAR) system which provides a notation display service with imperceptible latency and low energy consumption on regular mobile devices.

Abstract:

This paper presents MARVEL, a mobile augmented reality (MAR) system which provides a notation display service with imperceptible latency (<100 ms) and low energy consumption on regular mobile devices. In contrast to conventional MAR systems, which recognize objects using image-based computations performed in the cloud, MARVEL mainly utilizes a mobile device's local inertial sensors for recognizing and tracking multiple objects, while computing local optical flow and ofloading images only when necessary. We propose a system architecture which uses local inertial tracking, local optical flow, and visual tracking in the cloud synergistically. On top of that, we investigate how to minimize the overhead for image computation and ofloading. We have implemented and deployed a holistic prototype system in a commercial building and evaluate MARVEL's performance. The eficient use of a mobile device's capabilities lowers latency and energy consumption without sacrificing accuracy.

You may want to know: