Human modelling and animation from monocular images

Human modelling and animation from monocular images

Motion reconstruction:

Dance Sequence:

Source Reconstructed (front) Reconstructed (side)

Synthesized walking sequence for comparison purpose:

(Only the side view is used for reconstruction, but the 3D information is available for comparison.

The black color represents the source and the red represents the reconstructed information.)

Model reconstruction:

Reconstruction of an adult body:

Reconstruction of a child body:

Selected Publications:

Lao Zhiqiang, LI Ling, "Model-based Approach to Human Recognition", The 3rd International Conference on Computer Vision, Pattern Recognition and Image Processing, Atlantic City, USA, Feb 2000.

Lao Zhiqiang, LI Ling, "Video-based Approach to Human Animation", Computer Graphics Forum, Vol. 19 No. 3, Pg. C-401, August 2000.

Shan Liang, LI Ling, "Feature Based Articulated Human Posture Reconstruction From Monocular Video Sequences", The International Conference on Imaging Science, System and Technology, Las Vegas, USA, June, 2001.

Zhao Jianhui, LI Ling, "Energy Optimization for Human Animation from Monocular Images", The International Conference on Imaging Science, System and Technology, Las Vegas, USA, June, 2001.

Zhao Jianhui, Ling LI, "Model-based Human Posture Reconstruction from Monocular Image", Proc. of the 3rd International Conference on Information, Communication and Signal Processing (ICICS’01), Oct. 2001, Singapore.

Ling LI, Shan Liang, "Articulated Human Posture Reconstruction from Tracked Monocular Video Sequences", Proc. of the 3rd International Conference on Information, Communication and Signal Processing (ICICS’01), Oct. 2001, Singapore.

Zhao Jianhui, Ling LI, Kwoh Chee Keong, "Human Posture Reconstruction from Monocular Images based on Criterion Function”, Proc. of the 5^th International Conference on Computer Graphics and Imaging (CGIM 2002), August, 2002, Hawaii, USA.

Zhao Jianhui, Ling LI, Kwoh Chee Keong, “Hierarchical Approach for Human Animation from Monocular Images”, Proc. of the 2nd International Conference of Visualization, Imaging and Image Processing (VIIP 2002), September, 2002, Malaga, Spain.

Zhao Jianhui, Ling LI, “A Model-based Approach for Human Motion Reconstruction from Monocular Images”, International Conference of Information Technology and Application (ICITA 2004), January, 2004, Harbin, China.

Zhao Jianhui, Ling LI, “Human Motion Reconstruction from Monocular Images using Genetic Algorithms”, Computer Animation and Virtual World, Vol.15 No. 3-4 Pg. 407-414, July 2004.

Eng Peng, Ling LI, “Acquiring 3D Human Model from Uncalibrated Monocular Image Sequence”, to be published in the 4^th International Conference on Visualization, Imaging and Image Processing (VIIP 2004), September 2004, Marbella, Spain.

Zhao Jianhui, Ling LI, Kwoh Chee Keong, “Criterion Functions and Hierarchical Approach for Human Animation from Monocular Images”, the International Journal of Images and Graphics. Vol. 2, No. 2, 2005

Jianhui Zhao, Ling LI, “Human Animation Based on Motion Extraction and Reconstruction from Monocular Images”, the International Conference on Computer Vision and Graphics, September 2004, Warsaw, Poland.

Eng Peng, Ling LI, “3D Human Modeling from Video Sequences”, the International Conference on Computer Vision and Graphics, September 2004, Warsaw, Poland.

Zhao Jianhui, Ling LI, Kwoh Chee Keong, “3D Posture Reconstruction and Human Animation from 2D Feature Points”, Computer Graphics Forum, Vol. 24, Issue 4, 2005.

En Peng, Ling Li , “Estimation of Human Skeleton Proportion from 2D Uncalibrated Monocular Data”, Computer Animation and Social Agents 2005, Oct. 2005, Hong Kong , China .

En Peng, Ling Li, “Modeling Human Skeleton Proportions from Monocular Data”, WSEAS Transactions on Computers.Vol. 3, No. 6, 2006.

Li Zhang, Ling Li , “3D Human Animation from 2D Monocular Data Based on Motion Trend Prediction”, The 14^th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Pluzen, Czech, Jan. 31 – Feb. 2, 2006.

En Peng, Ling Li , “Human Skeleton Modeling from 2D Uncalibrated Monocular Data”, The 14^th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Pluzen, Czech, Jan. 31 – Feb. 2, 2006.

Li Zhang, Ling Li , “Smooth Human Animation from 2D Correspondence Based on
Motion Trend Prediction”, 5th WSEAS Int.Conf. on ARTIFICIAL INTELLIGENCE, KNOWLEDGE ENGINEERING and DATA BASES (AIKED '06), Madrid , Spain , Feb.2006.

En Peng, Ling Li , “Human Skeleton Proportions Recovery from Monocular Data”, the 5th WSEAS International Conference on SIGNAL PROCESSING, ROBOTICS and AUTOMATION (ISPRA '06), Madrid , Spain , Feb.2006.

Li Zhang, Ling Li , “Human Animation from 2D correspondence Based on Motion Trend Prediction”, Proceedings of Computer Graphics International 2006, LNCS4035, July 2006.

Li Zhang, Ling Li, “3D Human Animation from 2D Image Features based on Motion Trend Prediction”, WSEAS Transactions on Signal Processing. Issue 2, Volume 2, Feb. 2006.

En Peng, Ling Li , “Human Skeleton Proportions from Monocular Data”, Journal of Zhejiang University Science, An International Applied Physics and Engineering Journal. Vo. 7, No. 7, July 2006.

Li Zhang, Ling Li , "Monocular Reconstruction of Human Translation in Motion Sequence by MTA", Graphite 2007, Perth , Western Australia , December 2007.

Ling Li , "3D Human Modeling and Animation based on Monocular Images", Keynote address in The International Conference 2007 on Information Computing and Automation (ICICA 2007), Chengdu, China, December 2007.

En Peng and Ling Li , "Automatic Identification of the Stance Foot from Monocular Video without Gait Analysis", The International Conference 2007 on Information Computing and Automation (ICICA 2007), Chengdu , China , December 2007.

Li Zhang, Ling Li , "Monocular Reconstruction of Human Motion by MTP with Weighting Parameter Determination", The International Conference 2007 on Information Computing and Automation (ICICA 2007), Chengdu , China December 2007.