Hyperion: A wearable augmented reality system for text extraction and manipulation in the air

Dimitris Chatzopoulos; Carlos Bermejo; Zhanpeng Huang; Arailym Butabayeva; Rui Zheng; Morteza Golkarifard; Pan Hui

doi:10.1145/3083187.3084017

Hyperion: A wearable augmented reality system for text extraction and manipulation in the air

Dimitris Chatzopoulos
, Carlos Bermejo
, Zhanpeng Huang
, Arailym Butabayeva
, Rui Zheng
, Morteza Golkarifard
, Pan Hui

Department of Computer Science and Engineering

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

13 Citations (Scopus)

Abstract

We develop Hyperion a Wearable Augmented Reality (WAR) system based on Google Glass to access text information in the ambient environment. Hyperion is able to retrieve text content from users' current view and deliver the content to them in different ways according to their context.We design four work modalities for different situations that mobile users encounter in their daily activities. In addition, user interaction interfaces are provided to adapt to different application scenarios. Although Google Glass may be constrained by its poor computational capabilities and its limited battery capacity, we utilize code-level offloading to companion mobile devices to improve the runtime performance and the sustainability of WAR applications. System experiments show that Hyperion improves users ability to be aware of text information around them. Our prototype indicates promising potential of converging WAR technology and wearable devices such as Google Glass to improve people's daily activities.

Original language	English
Title of host publication	Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017
Publisher	Association for Computing Machinery, Inc
Pages	284-295
Number of pages	12
ISBN (Electronic)	9781450334891
DOIs	https://doi.org/10.1145/3083187.3084017
Publication status	Published - 20 Jun 2017
Event	8th ACM Multimedia Systems Conference, MMSys 2017 - Taipei, Taiwan, Province of China Duration: 20 Jun 2017 → 23 Jun 2017

Publication series

Name	Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017

Conference

Conference	8th ACM Multimedia Systems Conference, MMSys 2017
Country/Territory	Taiwan, Province of China
City	Taipei
Period	20/06/17 → 23/06/17

Bibliographical note

Publisher Copyright:
© 2017 Association for Computing Machinery.

Keywords

AR
Google glass
Offloading
Smart-glass
WAR
Wearable

Access to Document

10.1145/3083187.3084017

Cite this

Chatzopoulos, D., Bermejo, C., Huang, Z., Butabayeva, A., Zheng, R., Golkarifard, M., & Hui, P. (2017). Hyperion: A wearable augmented reality system for text extraction and manipulation in the air. In Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017 (pp. 284-295). (Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017). Association for Computing Machinery, Inc. https://doi.org/10.1145/3083187.3084017

@inproceedings{3f5f18e64511427494e83802c0c81d31,

title = "Hyperion: A wearable augmented reality system for text extraction and manipulation in the air",

abstract = "We develop Hyperion a Wearable Augmented Reality (WAR) system based on Google Glass to access text information in the ambient environment. Hyperion is able to retrieve text content from users' current view and deliver the content to them in different ways according to their context.We design four work modalities for different situations that mobile users encounter in their daily activities. In addition, user interaction interfaces are provided to adapt to different application scenarios. Although Google Glass may be constrained by its poor computational capabilities and its limited battery capacity, we utilize code-level offloading to companion mobile devices to improve the runtime performance and the sustainability of WAR applications. System experiments show that Hyperion improves users ability to be aware of text information around them. Our prototype indicates promising potential of converging WAR technology and wearable devices such as Google Glass to improve people's daily activities.",

keywords = "AR, Google glass, Offloading, Smart-glass, WAR, Wearable",

author = "Dimitris Chatzopoulos and Carlos Bermejo and Zhanpeng Huang and Arailym Butabayeva and Rui Zheng and Morteza Golkarifard and Pan Hui",

note = "Publisher Copyright: {\textcopyright} 2017 Association for Computing Machinery.; 8th ACM Multimedia Systems Conference, MMSys 2017 ; Conference date: 20-06-2017 Through 23-06-2017",

year = "2017",

month = jun,

day = "20",

doi = "10.1145/3083187.3084017",

language = "English",

series = "Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017",

publisher = "Association for Computing Machinery, Inc",

pages = "284--295",

booktitle = "Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017",

}

Chatzopoulos, D, Bermejo, C, Huang, Z, Butabayeva, A, Zheng, R, Golkarifard, M & Hui, P 2017, Hyperion: A wearable augmented reality system for text extraction and manipulation in the air. in Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017. Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017, Association for Computing Machinery, Inc, pp. 284-295, 8th ACM Multimedia Systems Conference, MMSys 2017, Taipei, Taiwan, Province of China, 20/06/17. https://doi.org/10.1145/3083187.3084017

Hyperion: A wearable augmented reality system for text extraction and manipulation in the air. / Chatzopoulos, Dimitris; Bermejo, Carlos; Huang, Zhanpeng et al.
Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017. Association for Computing Machinery, Inc, 2017. p. 284-295 (Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017).

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

TY - GEN

T1 - Hyperion

T2 - 8th ACM Multimedia Systems Conference, MMSys 2017

AU - Chatzopoulos, Dimitris

AU - Bermejo, Carlos

AU - Huang, Zhanpeng

AU - Butabayeva, Arailym

AU - Zheng, Rui

AU - Golkarifard, Morteza

AU - Hui, Pan

PY - 2017/6/20

Y1 - 2017/6/20

N2 - We develop Hyperion a Wearable Augmented Reality (WAR) system based on Google Glass to access text information in the ambient environment. Hyperion is able to retrieve text content from users' current view and deliver the content to them in different ways according to their context.We design four work modalities for different situations that mobile users encounter in their daily activities. In addition, user interaction interfaces are provided to adapt to different application scenarios. Although Google Glass may be constrained by its poor computational capabilities and its limited battery capacity, we utilize code-level offloading to companion mobile devices to improve the runtime performance and the sustainability of WAR applications. System experiments show that Hyperion improves users ability to be aware of text information around them. Our prototype indicates promising potential of converging WAR technology and wearable devices such as Google Glass to improve people's daily activities.

AB - We develop Hyperion a Wearable Augmented Reality (WAR) system based on Google Glass to access text information in the ambient environment. Hyperion is able to retrieve text content from users' current view and deliver the content to them in different ways according to their context.We design four work modalities for different situations that mobile users encounter in their daily activities. In addition, user interaction interfaces are provided to adapt to different application scenarios. Although Google Glass may be constrained by its poor computational capabilities and its limited battery capacity, we utilize code-level offloading to companion mobile devices to improve the runtime performance and the sustainability of WAR applications. System experiments show that Hyperion improves users ability to be aware of text information around them. Our prototype indicates promising potential of converging WAR technology and wearable devices such as Google Glass to improve people's daily activities.

KW - AR

KW - Google glass

KW - Offloading

KW - Smart-glass

KW - WAR

KW - Wearable

UR - https://www.scopus.com/pages/publications/85025617728

U2 - 10.1145/3083187.3084017

DO - 10.1145/3083187.3084017

M3 - Conference Paper published in a book

AN - SCOPUS:85025617728

T3 - Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017

SP - 284

EP - 295

BT - Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017

PB - Association for Computing Machinery, Inc

Y2 - 20 June 2017 through 23 June 2017

ER -

Chatzopoulos D, Bermejo C, Huang Z, Butabayeva A, Zheng R, Golkarifard M et al. Hyperion: A wearable augmented reality system for text extraction and manipulation in the air. In Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017. Association for Computing Machinery, Inc. 2017. p. 284-295. (Proceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017). doi: 10.1145/3083187.3084017

Hyperion: A wearable augmented reality system for text extraction and manipulation in the air

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this