EatingTrak: Detecting fine-grained eating moments in the wild using a wrist-mounted IMU
The ACM International Conference on Mobile Human-Computer Interaction MobileHCI ’22 (To Appear)
Ruidong Zhang, Jihai Zhang, Nitish Gade, Peng Cao, Se Yun Kim, Yizhuo Chen, Junchi Yan, Cheng Zhang
BodyTrak: Inferring Full-body Poses from Body Silhouettes Using a Miniature Camera on a Wristband
Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp ’22
Hyunchul Lim, Yaxuan Li, Matthew Dressa, Fang HU, Jae Hoon Kim, Ruidong Zhang, Cheng Zhang
EarIO: A Low-power Acoustic Sensing Earable for Continuously Tracking Detailed Facial Movements
Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp ’22
Ke Li, Ruidong Zhang, Bo Liang, Francois Guimbretiere, Cheng Zhang
SpeeChin: A Smart Necklace for Silent Speech Recognition
Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp ’21
Ruidong Zhang, Mingyang Chen, Benjamin Steeper, Yaxuan Li, Zihan Yan, Yizhuo Chen, Songyun Tao, Tuochao Chen, Hyunchul Lim, Cheng Zhang
Selected Media Coverage: Cornell Chronicle , Gizmodo , Hackster, News Atlas , Tech Xplore.
HandyTrak: Recognizing the Holding Hand on a Commodity Smartphone from Body Silhouette Images
The ACM Symposium on User Interface Software and Technology (UIST) ’21
Hyunchul Lim, David Lin , Jessica Tweneboah, Cheng Zhang
ThumbTrak: Recognizing Micro-finger Poses Using a Ring with Proximity Sensing
ACM International Conference on Mobile Human-Computer Interaction (MobileHCI) ’21
Wei Sun, Franklin Mingzhe Li, Congshu Huang, Zhenyu Lei, Benjamin Steeper, Songyun Tao, Feng Tian, Cheng Zhang
NeckFace: Continuously Tracking Full Facial Expressions on Neck-mounted Wearables
Published on Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp ’21
Tuochao Chen, Yaxuan Li, Songyun Tao, Hyunchul Lim, Mose Sakashita, Ruidong Zhang, Francois Guimbretiere, Cheng Zhang
Selected Media Coverage: Cornell Chronicle , News Atlas , Hackster
TeethTap: Recognizing Discrete Teeth Gestures using Motion and Acoustic Sensing on an Earpiece.
The 26th Annual Conference on Intelligent User Interfaces (IUI'21)
Wei Sun, Franklin Mingzhe Li, Benjamin Steeper, Songlin Xu, Feng Tian, Cheng Zhang
C-Face: Continuously reconstructing facial expressions by deep learning contours of the face with ear-mounted miniature cameras
ACM Symposium on User Interface Software and Technology (UIST) UIST ’20
Tuochao Chen, Benjamin Steeper, Kinan Alsheikh, Songyun Tao, Francois Guimbretiere, Cheng Zhang
Selected Media Coverage: Cornell Chronicle , Engadget , New Scientist, NowThis(Twitter, Facebook, Youtube) Yahoo , Mashable, New Atlas, South China Morning Post.
VibroSense: Recognizing Home Activities by Deep Learning Subtle Vibrations on an Interior Surface of a House from a Single Point Using Laser Doppler Vibrometry
Published on Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/Ubicomp’20
Wei Sun, Tuochao Chen, Jiayi Zheng, Zhenyu Lei, Lucy Wang, Benjamin Steeper, Peng He, Matthew Dressa, Feng Tian, Cheng Zhang
Selected Media Coverage: Cornell Chronicle, Engadget, NewAtlas, Yahoo, TechExplore, PhysicsWorld, The Engineer, Hackster .
FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist.
Published on Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/Ubicomp’20, Accepted with minor revision (top 1-2%), ECCV'20 Best Demo Honorable Mention (Top 3 Demos)
Fang Hu, Peng He, Songlin Xu, Yin Li, Cheng Zhang
Selected Media Coverage: BBC, Forbes, Cornell Chronicle, Engadget, Gizmodo, VentureBeat, Yahoo, VisionSystemDesign.
WristWash: Towards Automatic Handwashing Assessment Using a Wrist-worn Device
Published on 2018 International Symposium on Wearable Computers (ISWC’18)
Hong Li, Shishir Chawla, Richard Li, Sumeet Jain, Gregory D. Abowd, Thad Starner, Cheng Zhang, Thomas Plötz
FingerPing: Recognizing Fine-Grained Hand Poses Using Active Acoustics Extraction from the Body
Published on Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18)
Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Ruichen Meng, Sumeet Jain, Yizeng Han, Xinyu Li, Kenneth Cunefare, Thomas Plötz, Thad Starner, Omer Inan, Gregory D. Abowd
FingerSound: Recognizing unistroke thumb gestures using a ring
Published on Proc. ACM Interact. Mob. Wearable Ubiquitous Technology(IMWUT). Issue 3 /Ubicomp’17
Cheng Zhang, Anandghan Waghmare, Pranav Kundra, Yiming Pu, Scott Gilliland, Thomas Ploetz, Thad E. Starner, Omer T. Inan, Gregory D. Abowd
FingerOrbits: Interaction with Wearables Using Synchronized Thumb Movements
Published on 2017 international symposium on wearable computers (ISWC’17).
Cheng Zhang, Xiaoxuan Wang, Anandghan Waghmare, Sumeet Jain, Thomas Ploetz, Omer T.Inan, Thad E. Starner, Gregory D. Abowd
SoundTrak: Continuous 3D Finger Tracking Using Active Acoustics
Published on Proc. ACM Interact. Mob. Wearable UbiquitousTechnol. 1, 2, Article 30 (June 2017) / Ubicomp 2017.
Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Sumeet Jain, Yiming Pu Sinan Hersek, Kent Lyons, Kenneth A. Cunefare, Omer T.Inan, Gregory D. Abowd
TapSkin: Recognizing On-Skin Input for Smartwatches
Published on 2016 ACM International Conference on Interactive Surfaces and Spaces.
Cheng Zhang, AbdelKareen Bedri, Gabriel Reyes, Bailey Bercik, Omer T. Inan, Thad E. Starner, Gregory D. Abowd