C-Face: Continuously reconstructing facial expressions by deep learning contours of the face with ear-mounted miniature cameras

To appear on ACM Symposium on User Interface Software and Technology (UIST) UIST ’20

Tuochao Chen, Benjamin Steeper, Kinan Alsheikh, Songyun Tao, Francois Guimbretiere, Cheng Zhang

Selected Media Coverage: Cornell Chronicle , Engadget , New Scientist, NowThis(Twitter, Facebook, Youtube) Yahoo , Mashable,  New Atlas, South China Morning Post.

VibroSense: Recognizing Home Activities by Deep Learning Subtle Vibrations on an Interior Surface of a House from a Single Point Using Laser Doppler Vibrometry

Published on Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/Ubicomp’20

Wei Sun, Tuochao Chen,  Jiayi Zheng,  Zhenyu Lei, Lucy Wang,  Benjamin Steeper, Peng He, Matthew Dressa, Feng Tian, Cheng Zhang

Selected Media Coverage: Cornell Chronicle, Engadget,  NewAtlas,  Yahoo, TechExplore, PhysicsWorld, The Engineer, Hackster . 

FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist. 

Published on Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/Ubicomp’20,  ECCV'20 Best Demo Honorable Mention (Top 3 Demos)

Fang Hu, Peng He, Songlin Xu, Yin Li, Cheng Zhang

Selected Media Coverage: BBC, Forbes, Cornell Chronicle, Engadget, Gizmodo, VentureBeat, Yahoo, VisionSystemDesign. 

 

WristWash: Towards Automatic Handwashing Assessment Using a Wrist-worn Device  

Published on 2018 International Symposium on Wearable Computers (ISWC’18)

Hong Li, Shishir Chawla, Richard Li, Sumeet Jain, Gregory D. Abowd, Thad Starner, Cheng Zhang, Thomas Plötz

​

FingerPing: Recognizing Fine-Grained Hand Poses Using Active Acoustics Extraction from the Body  

Published on Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18)

Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Ruichen Meng, Sumeet Jain, Yizeng Han, Xinyu Li, Kenneth Cunefare, Thomas Plötz, Thad Starner, Omer Inan, Gregory D. Abowd

FingerSound: Recognizing unistroke thumb gestures using a ring 

Published on Proc. ACM Interact. Mob. Wearable Ubiquitous Technology(IMWUT). Issue 3 /Ubicomp’17

Cheng Zhang, Anandghan Waghmare, Pranav Kundra, Yiming Pu, Scott Gilliland, Thomas Ploetz, Thad E. Starner, Omer T. Inan, Gregory D. Abowd

FingerOrbits: Interaction with Wearables Using Synchronized Thumb Movements 

Published on 2017 international symposium on wearable computers (ISWC’17).

Cheng Zhang, Xiaoxuan Wang, Anandghan Waghmare, Sumeet Jain, Thomas Ploetz, Omer T.Inan, Thad E. Starner, Gregory D. Abowd

SoundTrak: Continuous 3D Finger Tracking Using Active Acoustics

Published on Proc. ACM Interact. Mob. Wearable UbiquitousTechnol. 1, 2, Article 30 (June 2017) / Ubicomp 2017.

Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Sumeet Jain, Yiming Pu Sinan Hersek, Kent Lyons, Kenneth A. Cunefare, Omer T.Inan, Gregory D. Abowd

TapSkin: Recognizing On-Skin Input for Smartwatches

Published on 2016 ACM International Conference on Interactive Surfaces and Spaces.

Cheng Zhang, AbdelKareen Bedri, Gabriel Reyes, Bailey Bercik, Omer T. Inan, Thad E. Starner, Gregory D. Abowd

​