Sensing multimedia contexts on mobile devices

Mohammad A. Hoque; Ashwin Rao; Abhishek Kumar; Mostafa Ammar; Pan Hui; Sasu Tarkoma

doi:10.1145/3386290.3396935

Sensing multimedia contexts on mobile devices

Mohammad A. Hoque, Ashwin Rao, Abhishek Kumar, Mostafa Ammar, Pan Hui, Sasu Tarkoma

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

4 Citations (Scopus)

Abstract

We use various multimedia applications on smart devices to consume multimedia content, to communicate with our peers, and to broadcast our events live. This paper investigates the utilization of different media input/output devices, e.g., camera, microphone, and speaker, by different types of multimedia applications, and introduces the notion of multimedia context. Our measurements lead to a sensing algorithm called MediaSense, which senses the states of multiple I/O devices and identifies eleven multimedia contexts of a mobile device in real time. The algorithm distinguishes stored content playback from streaming, live broadcasting from local recording, and conversational multimedia sessions from GSM/VoLTE calls on mobile devices.

Original language	English
Title of host publication	NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020
Publisher	Association for Computing Machinery
Pages	40-46
Number of pages	7
ISBN (Electronic)	9781450379458
DOIs	https://doi.org/10.1145/3386290.3396935
Publication status	Published - 10 Jun 2020
Externally published	Yes
Event	30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2020, Part of MMSys 2020 - Istanbul, Turkey Duration: 10 Jun 2020 → 11 Jun 2020

Publication series

Name	NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020

Conference

Conference	30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2020, Part of MMSys 2020
Country/Territory	Turkey
City	Istanbul
Period	10/06/20 → 11/06/20

Bibliographical note

Publisher Copyright:
© 2020 ACM.

Keywords

Live streaming
Multimedia context
Network management
Sensor fusion
Traffic classification
Virtual reality
Voice over IP

Access to Document

10.1145/3386290.3396935

Cite this

Hoque, M. A., Rao, A., Kumar, A., Ammar, M., Hui, P., & Tarkoma, S. (2020). Sensing multimedia contexts on mobile devices. In NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020 (pp. 40-46). (NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020). Association for Computing Machinery. https://doi.org/10.1145/3386290.3396935

Hoque, Mohammad A. ; Rao, Ashwin ; Kumar, Abhishek et al. / Sensing multimedia contexts on mobile devices. NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020. Association for Computing Machinery, 2020. pp. 40-46 (NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020).

@inproceedings{176a288aa8b64efdab482a3bdb072519,

title = "Sensing multimedia contexts on mobile devices",

abstract = "We use various multimedia applications on smart devices to consume multimedia content, to communicate with our peers, and to broadcast our events live. This paper investigates the utilization of different media input/output devices, e.g., camera, microphone, and speaker, by different types of multimedia applications, and introduces the notion of multimedia context. Our measurements lead to a sensing algorithm called MediaSense, which senses the states of multiple I/O devices and identifies eleven multimedia contexts of a mobile device in real time. The algorithm distinguishes stored content playback from streaming, live broadcasting from local recording, and conversational multimedia sessions from GSM/VoLTE calls on mobile devices.",

keywords = "Live streaming, Multimedia context, Network management, Sensor fusion, Traffic classification, Virtual reality, Voice over IP",

author = "Hoque, \{Mohammad A.\} and Ashwin Rao and Abhishek Kumar and Mostafa Ammar and Pan Hui and Sasu Tarkoma",

note = "Publisher Copyright: {\textcopyright} 2020 ACM.; 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2020, Part of MMSys 2020 ; Conference date: 10-06-2020 Through 11-06-2020",

year = "2020",

month = jun,

day = "10",

doi = "10.1145/3386290.3396935",

language = "English",

series = "NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020",

publisher = "Association for Computing Machinery",

pages = "40--46",

booktitle = "NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020",

}

Hoque, MA, Rao, A, Kumar, A, Ammar, M, Hui, P & Tarkoma, S 2020, Sensing multimedia contexts on mobile devices. in NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020. NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020, Association for Computing Machinery, pp. 40-46, 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2020, Part of MMSys 2020, Istanbul, Turkey, 10/06/20. https://doi.org/10.1145/3386290.3396935

Sensing multimedia contexts on mobile devices. / Hoque, Mohammad A.; Rao, Ashwin; Kumar, Abhishek et al.
NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020. Association for Computing Machinery, 2020. p. 40-46 (NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020).

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

TY - GEN

T1 - Sensing multimedia contexts on mobile devices

AU - Hoque, Mohammad A.

AU - Rao, Ashwin

AU - Kumar, Abhishek

AU - Ammar, Mostafa

AU - Hui, Pan

AU - Tarkoma, Sasu

PY - 2020/6/10

Y1 - 2020/6/10

N2 - We use various multimedia applications on smart devices to consume multimedia content, to communicate with our peers, and to broadcast our events live. This paper investigates the utilization of different media input/output devices, e.g., camera, microphone, and speaker, by different types of multimedia applications, and introduces the notion of multimedia context. Our measurements lead to a sensing algorithm called MediaSense, which senses the states of multiple I/O devices and identifies eleven multimedia contexts of a mobile device in real time. The algorithm distinguishes stored content playback from streaming, live broadcasting from local recording, and conversational multimedia sessions from GSM/VoLTE calls on mobile devices.

AB - We use various multimedia applications on smart devices to consume multimedia content, to communicate with our peers, and to broadcast our events live. This paper investigates the utilization of different media input/output devices, e.g., camera, microphone, and speaker, by different types of multimedia applications, and introduces the notion of multimedia context. Our measurements lead to a sensing algorithm called MediaSense, which senses the states of multiple I/O devices and identifies eleven multimedia contexts of a mobile device in real time. The algorithm distinguishes stored content playback from streaming, live broadcasting from local recording, and conversational multimedia sessions from GSM/VoLTE calls on mobile devices.

KW - Live streaming

KW - Multimedia context

KW - Network management

KW - Sensor fusion

KW - Traffic classification

KW - Virtual reality

KW - Voice over IP

UR - http://www.scopus.com/inward/record.url?scp=85086595527&partnerID=8YFLogxK

U2 - 10.1145/3386290.3396935

DO - 10.1145/3386290.3396935

M3 - Conference Paper published in a book

AN - SCOPUS:85086595527

T3 - NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020

SP - 40

EP - 46

BT - NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020

PB - Association for Computing Machinery

T2 - 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2020, Part of MMSys 2020

Y2 - 10 June 2020 through 11 June 2020

ER -

Hoque MA, Rao A, Kumar A, Ammar M, Hui P, Tarkoma S. Sensing multimedia contexts on mobile devices. In NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020. Association for Computing Machinery. 2020. p. 40-46. (NOSSDAV 2020 - Proceedings of the 2020 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2020). doi: 10.1145/3386290.3396935

Sensing multimedia contexts on mobile devices

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this