Recent studies validated the feasibility of estimating heart rate from human faces in RGB video. However, test subjects are often recorded under controlled conditions, as illumination variations significantly affect the RGB-based heart rate estimation accuracy. Intel newly-announced low-cost RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door to new and more robust computer vision. RealSense cameras produce RGB images with extra depth information inferred from a latent nearinfrared (NIR) channel. In this paper, we experimentally demonstrate, for the first time, that heart rate can be reliably estimated from RealSense near-infrared images. This enables illumination invariant heart rate estimation, extending the heart rate from video feasibility to low-light applications, such as night driving. With the (coming) ubiquitous presence of RealSense devices, the proposed method not only utilizes its near-infrared channel, designed originally to be hidden from consumers; but also exploits the associated depth information for improved robustness to head pose.

+More

computer vision realsense cameras latent nearinfrared nir head pose depth information mobile newlyannounced lowcost realsense 3d rgbd camera illumination invariant heart rate estimation ubiquitous presence of realsense night driving lowlight human faces rgb images video feasibility illumination variations consumers

Li, XB ,Pietikainen, M,Bronstein, A ,Chang, ZQ ,Chen, J ,Sapiro, G ,Qiu, Q ,.RealSense = Real Heart Rate: Illumination Invariant Heart Rate Estimation from Videos. (),6.

Li, XB , et al."RealSense = Real Heart Rate: Illumination Invariant Heart Rate Estimation from Videos"

Li, XB ,Pietikainen, M,Bronstein, A ,Chang, ZQ ,Chen, J ,Sapiro, G ,Qiu, Q ,"RealSense = Real Heart Rate: Illumination Invariant Heart Rate Estimation from Videos"