Selected Publications  (Google scholar, DBLP)

Note that the symbol * indicates the author's research is supervised/co-supervised by Chai.

 

      Realtime 3D Eye Gaze Animation Using a Single RGB Camera

       with Congyi Wang*, Fuhao Shi*, Shihong Xia

       ACM Transactions on Graphics, 35(4): Article xxx, 2016.

       PDF; final video; youtube video

 

 

      Video-Audio Driven Real-Time Facial Animation

       with Feng Xu*, Yilong Liu*, Xin Tong

       ACM Transactions on Graphics, 34(6): Article 182, 2015.

       PDF; final video; youtube video

 

 

     

      Realtime Style Transfer for Unlabeled Heterogeneous Human Motion

       with Congyi Wang*, Shihong Xia, Jessica Hodgins

       ACM Transactions on Graphics, 34(4): Article 119, 2015.

       PDF; final video

 

 

 

      Automatic Acquisition of High-fidelity Facial Performances Using Monocular Videos    

       with Fuhao Shi*, Hsiang-Tao Wu and Xin Tong

       ACM Transactions on Graphics, 33(6): Article No. 222, 2014

       PDF; final video; project webpage

 

 

   

      Leveraging Depth Cameras and Wearable Pressure Sensors for Full-body Kinematics and Dynamics Capture    

       with Peizhao Zhao*, Kristin Siu, Jianjie Zhang*, C. Karen Liu

       ACM Transactions on Graphics, 33(6): Article No. 221, 2014.

       PDF; final video; project webpage

 

 

 

      Controllable High-fidelity Facial Performance Transfer    

       with Feng Xu*, Yilong Liu*, Xin Tong

       ACM Transactions on Graphics, 33(4): Article No. 42, 2014

       PDF; final video

 

 

 

       Accurate Robust 3D Facial Capture Using Single RGBD Images    

       with Yen-Lin Chen*, Fuhao Shi*, Hsiang-Tao Wu and Xin Tong

       IEEE International Conference on Computer Vision (ICCV 2013)

       PDF; final video;  more evaluations

 

 

       Robust Realtime Physically Based Motion Control for Human Grasping    

       with Wenping Zhao*, Jianjie Zhang* and Jianyuan Min*

       ACM Transactions on Graphics, 32(6): Article No. 207, 2013.

       PDF (7.2Mb); fastforward video; final video;  more evaluations

 

 

 

  

 

       Video-based Hand Manipulation Capture Through Composite Motion Control   

       with Yangang Wang*, Jianyuan Min*, Jianjie Zhang*, Yebin Liu, Feng Xu, Qionghai Dai

       ACM Transactions on Graphics, 32(4): Article No. 43, 2013.

       PDF (27.6Mb); fastforward video; final video;  more evaluations

       (Note: Yangang Wang and Jianyuan Min have equal contributions)

 

 

 

 

       Accurate Realtime Full-body Motion Capture Using a Single Depth Camera   

       with Xiaolin Wei* and Peizhao Zhang*

       ACM Transactions on Graphics, 31(6): Article No. 180, 2012

       PDF (8.5Mb); fastforward video; final videomore evaluations

 

 

http://minjianyuan.com/img/Semantic_v3.jpg

 

 

       Motion Graphs++: a Compact Generative Model for Semantic Motion Analysis and Synthesis

       with Jianyuan Min*

       ACM Transactions on Graphics, 31(6): Article No. 148, 2012.

       PDF (1.7Mb); final video; more evaluations

 

 

 

      Combining Marker-based Mocap and RGB-D Camera for Acquiring High-fidelity Hand Motion Data     

      With Wenping Zhao* and Ying-Qing Xu

      ACM SIGGRAPH/Eurographics Symposium on Computer Animation  (SCA 2012)      

      PDF (5.7Mb); final video (45Mb avi clip, no audio); youtube video

 

 

 

      

 

       Leveraging Motion Capture and 3D Scanning for High-Fidelity Facial Performance Acquisition

       with Haoda Huang*, Xin Tong, and Hsiang-Tao Wu 

       ACM Transactions on Graphics, 30(4): Article No. 74, 2011.

       PDF (31.7Mb); final video (118Mb avi clip, no audio)

 

 

 

  proj20

       

       Physically-Valid Statistical Models for Human Motion Synthesis

       with Xiaolin Wei* and Jianyuan Min* 

       ACM Transactions on Graphics, 30(3): Article No. 19, 2011.

       PDF (2.1Mb); final video (42Mb mov clip, no audio)

 

sketch_e

      Intuitive Interactive Human Character Posing with Millions of Example Poses

 with Xiaolin Wei*

 IEEE Computer Graphics and Applications (CG&A), 31(4), 2011

 PDF; final video (39.3Mb avi clip, no audio)

 

  

      Realtime Human Motion Control with A Small Number of Inertial Sensors

  with Huajun Liu*, Xiaolin Wei*, Inwoo Ha, and Taehyun Rhee

  ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (i3D 2011), 2011

PDF (5.6Mb);  final video (24Mb avi clip, no audio)

 

 

54B.png

  

      VideoMocap: Modeling Physically Realistic Human Motion from Monocular Video Sequences

      with Xiaolin Wei*

      ACM Transactions on Graphics, 29(4): Article No.  42, 2010.

      PDF(14.8Mb); final video (61Mb mov clip with audio); youtube video

 

tog_deformable

 

Interactive Generation of Human Animation with Deformable Motion Models

with Jianyuan Min* and Yen-Lin Chen*

ACM Transactions on Graphics, 29(1): Article No. 9, 2009.

PDF(5.8Mb); final video (99Mb mov clip with audio)

 

tog_face

 Interactive Manipulation of 3D Facial Expressions Using Facial Priors 

 with Manfred Lau*, Ying-Qing Xu and Harry Shum

 ACM Transactions on Graphics, 29(1): Article No. 3, 2009.

 PDF(9Mb); final video (52.6Mb mov clip with audio)

tvcg

 

 Example-based Human Motion Denoising

 with Hui Lou*

 IEEE Transactions on Visualization and Computer Graphics (TVCG), 16(5), 2010

 PDF (1.4Mb); final video (33.1Mb avi clip, no audio)

 

 

style

 

      Synthesis and Editing of Personalized Stylistic Human Motion

      with Jianyuana Min* and Huajun Liu*

      ACM SIGGRAPH Symposium on Interactive 3D graphics and games (i3D 2010)

      PDF; final video (72Mb mov clip, no audio)

 

iccv_09

Modeling 3D Human Poses from Uncalibrated Monocular Images

with Xiaolin Wei*

IEEE  International Conference on Computer Vision (ICCV 2009)

  PDF (5.8Mb);  final video (11.3Mb mov clip, no audio)

image006

  

3D Reconstruction of Human Motion and Skeleton from Uncalibrated Monocular Video

with Yen-Lin Chen*

The Ninth Asian Conference on Computer Vision (ACCV 2009)

PDF (2.2Mb);  final video (7.5Mb mov clip, no audio)

Winner of the best paper honorable mention award: 2 out of 670 submissions

 

projec2

 

  Registration of Human Motion Data Using Parameterized Motion Models  

  with Yen-Lin Chen* and Jianyuan Min*
  ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (i3D 2009)

PDF (3.7Mb);  final video

 

 

 

eccv08

 

Interactive Tracking of 2D generic Objects with Spacetime Optimization

with Xiaolin Wei*

The 10th European Conference on Computer Vision (ECCV 2008)

PDF (13.2Mb);  final video (14Mb avi clip, no audio)

 

A Hybrid Camera for Motion Deblurring and Depth Super-resolution

with Feng Li and Jingyi Yu

Proc. of Computer Vision and Pattern Recognition (CVPR 2008)

PDF (0.4Mb)

WalkJump

Constraint-based Motion Optimization Using A Statistical Dynamic Model 

with Jessica Hodgins

ACM Transactions on Graphics, 26(3): Article No. 8, 2007.

PDF (17.5Mb); final video (26Mb mov clip with audio)

 

tog-face

 

Face Poser: Interactive Facial Expression Modeling Using Model Priors

with Manfred Lau, Ying-Qing Xu and Harry Shum

ACM SIGGRAPH/Eurographics Symposium on Computer Animation  (SCA 2007)

PDF (1.5Mb); final video (17Mb avi clip with audio); slides

 

ijcv06

A Closed-form Solution to Nonrigid Shape and Motion Recovery

with Jing Xiao and Takeo Kanade

International Journal of Computer Vision (IJCV), Vol. 67, No. 2, 2006

PDF (0.5 Mb);  Best Papers for the ECCV 2004 Special Issue, 5 out of 555 submissions 

 

 

      Performance Animation from Low-dimensional Control Signals

with Jessica Hodgins

ACM Transactions on Graphics, 24(3): 686-696, 2005.

PDF (1.6Mb); final video (83Mb mov clip with audio)

 

ijcv06

 A Closed-form Solution to Nonrigid Shape and Motion Recovery

with Jing Xiao and Takeo Kanade

Proceedings of the 8th European Conference on Computer Vision (ECCV 2004).

PDF (0.9Mb)

sca03

Vision-based Control of 3D Facial Animation

with Jing Xiao and Jessica Hodgins

ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2003)

PDF(2.5Mb); final video (15.6 MB avi clip, no audio)

motion-graph

Interactive Control of Avatars Animated with Human Motion Data,

with Jehee Lee, Paul Reitsma, Jessica Hodgins and Nancy Pollard

ACM Transactions on Graphics, 21(3): 491-500, 2012.

PDF (7.7Mb); final video (52Mb avi clip with audio)

 mosacing

A Low Cost Projector Mosaic

with Ramesh Raskar and Jeron vanBaar

Proc. of Asia Conference on Computer Vision (ACCV 2002)

PDF (2.0Mb); Google scholar link

proj15

Rendering with Manifold Hopping

with Li-Feng Wang, Harry Shum and Xin Tong

International Journal of Computer Vision (IJCV), Vol. 50, No. 2, 2002.

PDF (1.9Mb); Google scholar link

projec16

Layered lumigraph with LOD control

with Xin Tong and Harry Shum

Journal of Visualization and Computer Animation, Vol. 13, No. 4, 2002.

PDF (3.8Mb); Google scholar link

cvpr01_right

Handling Occlusions in Dense Multi-view Stereo

      with Sing Bing Kang and Rickard Szeliski

      IEEE Conf. on  Computer Vision and Pattern Recognition (CVPR 2001)

      PDF (0.88Mb); Google scholar link

 sampling

Plenoptic Sampling

with Xin Tong, Harry Shum and Shing-Chow Chan

ACM SIGGRAPH 2000

PDF (11.6Mb); Google scholar link 

 projec7

Parallel Projections for Stereo Reconstruction

      with Harry Shum

      IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2000), 2000

      PDF (0.34Mb); Google scholar link 


 

Jinxiang Chai
Last Updated: Aug
20, 2015