Accurate and efficient pulse measurement from facial videos on smartphones

Chong Huang; Xin Yang; Kwang Ting Tim Cheng

doi:10.1109/WACV.2016.7477669

Accurate and efficient pulse measurement from facial videos on smartphones

Chong Huang, Xin Yang, Kwang Ting Tim Cheng

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

6 Citations (Scopus)

Abstract

Non-contact measurement of cardiac pulse signals has attracted high interests due to its convenience and cost effectiveness. However, extracting pulse signals on mobile handheld devices (e.g. smartphones) based on face videos captured by mobile cameras usually suffers from low measurement accuracy due to misalignment errors in face tracking and inevitable illumination changes in a mobile scenario, and low efficiency due to a handheld's limited computing power. We propose two techniques to address these limitations: 1) an accurate and efficient face tracking method based on an Active Shape Model (ASM) and the LDB (Local Difference Binary) feature description; 2) an adaptive temporal filtering method which can detect, and in turn denoise, sharp intensity changes in the source trace. Experimental results demonstrate that the proposed solution can achieve a speedup of 6.2X and is robust to noises in common mobile scenarios.

Original language	English
Title of host publication	2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781509006410
DOIs	https://doi.org/10.1109/WACV.2016.7477669
Publication status	Published - 23 May 2016
Externally published	Yes
Event	IEEE Winter Conference on Applications of Computer Vision, WACV 2016 - Lake Placid, United States Duration: 7 Mar 2016 → 10 Mar 2016

Publication series

Name	2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016

Conference

Conference	IEEE Winter Conference on Applications of Computer Vision, WACV 2016
Country/Territory	United States
City	Lake Placid
Period	7/03/16 → 10/03/16

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Access to Document

10.1109/WACV.2016.7477669

Cite this

Huang, C., Yang, X., & Cheng, K. T. T. (2016). Accurate and efficient pulse measurement from facial videos on smartphones. In 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016 Article 7477669 (2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WACV.2016.7477669

@inproceedings{a3b710f66e38495f850cfc27844dd89d,

title = "Accurate and efficient pulse measurement from facial videos on smartphones",

abstract = "Non-contact measurement of cardiac pulse signals has attracted high interests due to its convenience and cost effectiveness. However, extracting pulse signals on mobile handheld devices (e.g. smartphones) based on face videos captured by mobile cameras usually suffers from low measurement accuracy due to misalignment errors in face tracking and inevitable illumination changes in a mobile scenario, and low efficiency due to a handheld's limited computing power. We propose two techniques to address these limitations: 1) an accurate and efficient face tracking method based on an Active Shape Model (ASM) and the LDB (Local Difference Binary) feature description; 2) an adaptive temporal filtering method which can detect, and in turn denoise, sharp intensity changes in the source trace. Experimental results demonstrate that the proposed solution can achieve a speedup of 6.2X and is robust to noises in common mobile scenarios.",

author = "Chong Huang and Xin Yang and Cheng, \{Kwang Ting Tim\}",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; IEEE Winter Conference on Applications of Computer Vision, WACV 2016 ; Conference date: 07-03-2016 Through 10-03-2016",

year = "2016",

month = may,

day = "23",

doi = "10.1109/WACV.2016.7477669",

language = "English",

series = "2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016",

}

Huang, C, Yang, X & Cheng, KTT 2016, Accurate and efficient pulse measurement from facial videos on smartphones. in 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016., 7477669, 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016, Institute of Electrical and Electronics Engineers Inc., IEEE Winter Conference on Applications of Computer Vision, WACV 2016, Lake Placid, United States, 7/03/16. https://doi.org/10.1109/WACV.2016.7477669

Accurate and efficient pulse measurement from facial videos on smartphones. / Huang, Chong; Yang, Xin; Cheng, Kwang Ting Tim.
2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016. Institute of Electrical and Electronics Engineers Inc., 2016. 7477669 (2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016).

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

TY - GEN

T1 - Accurate and efficient pulse measurement from facial videos on smartphones

AU - Huang, Chong

AU - Yang, Xin

AU - Cheng, Kwang Ting Tim

PY - 2016/5/23

Y1 - 2016/5/23

N2 - Non-contact measurement of cardiac pulse signals has attracted high interests due to its convenience and cost effectiveness. However, extracting pulse signals on mobile handheld devices (e.g. smartphones) based on face videos captured by mobile cameras usually suffers from low measurement accuracy due to misalignment errors in face tracking and inevitable illumination changes in a mobile scenario, and low efficiency due to a handheld's limited computing power. We propose two techniques to address these limitations: 1) an accurate and efficient face tracking method based on an Active Shape Model (ASM) and the LDB (Local Difference Binary) feature description; 2) an adaptive temporal filtering method which can detect, and in turn denoise, sharp intensity changes in the source trace. Experimental results demonstrate that the proposed solution can achieve a speedup of 6.2X and is robust to noises in common mobile scenarios.

AB - Non-contact measurement of cardiac pulse signals has attracted high interests due to its convenience and cost effectiveness. However, extracting pulse signals on mobile handheld devices (e.g. smartphones) based on face videos captured by mobile cameras usually suffers from low measurement accuracy due to misalignment errors in face tracking and inevitable illumination changes in a mobile scenario, and low efficiency due to a handheld's limited computing power. We propose two techniques to address these limitations: 1) an accurate and efficient face tracking method based on an Active Shape Model (ASM) and the LDB (Local Difference Binary) feature description; 2) an adaptive temporal filtering method which can detect, and in turn denoise, sharp intensity changes in the source trace. Experimental results demonstrate that the proposed solution can achieve a speedup of 6.2X and is robust to noises in common mobile scenarios.

UR - https://openalex.org/W2398314274

UR - https://www.scopus.com/pages/publications/84977628187

U2 - 10.1109/WACV.2016.7477669

DO - 10.1109/WACV.2016.7477669

M3 - Conference Paper published in a book

T3 - 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016

BT - 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - IEEE Winter Conference on Applications of Computer Vision, WACV 2016

Y2 - 7 March 2016 through 10 March 2016

ER -

Accurate and efficient pulse measurement from facial videos on smartphones

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this