PDL Abstract

Towards Wearable Cognitive Assistance

Proceedings of the 12th ACM International Conference on Mobile Computing, Systems and Services (MobiSys’14), June 2014.

Kiryong Ha, Zhuo Chen, Wenlu Hu, Wolfgang Richter, Padmanabhan Pillai*,
Mahadev Satyanarayanan

Carnegie Mellon University
* Intel Labs


We describe the architecture and prototype implementation of an assistive system based on Google Glass devices for users in cognitive decline. It combines the first-person image capture and sensing capabilities of Glass with remote processing to perform real-time scene interpretation. The system architecture is multi-tiered. It offers tight end-to-end latency bounds on compute-intensive operations, while addressing concerns such as limited battery capacity and limited processing capability of wearable devices. The system gracefully degrades services in the face of network failures and unavailability of distant architectural tiers.

KEYWORDS: wearable computing; mobile computing; cloud computing; cloudlet; cloud offload; cyber foraging; virtual machine; Google Glass