Shirley Temple and Albert Einstein are coming back on stage, ... virtually! Our system can create many virtual characters with different styles. It can match voice signals with lip/mouth shapes smoothly and automatically. The lip-sync can be done in real time (e.g. 20 frames per second) for several languages, including Chinese (Cantonese and Mandarin), English, French, German, Japanese and Spanish. In addition, a virtual character can express his/her emotion with different kinds of facial expressions.

Please enjoy the following movie clips. They are highly compressed using MPEG4 to reduce download time. They are in avi format and can be palyed on Windows Media Player or Real Player.

We've built a website to provide various movie clips for 2G and 3G mobile (cell) phones as well as PCs. You're welcome to visit it (www.hy8.com,or www.HyperAcademy.com) and enjoy more.

Shirley	Mary	Steve	Einstein
Song (266KB)	News (613KB) English Song (563KB) Chinese Song (360KB) Chinese Story (627KB) Facial expressions (584KB)	Speech in Chinese,  English, French, German, Japanese and Spanish (3.5MB)	Lecture (495KB)

Selected Publications

• S. K. Karunaratne and H. Yan, "A new efficient expression generation and automation cloning method for multimedia actors," Circuits, Systems and Signal Processing, 20(3):447-484, 2001.
• H. Yan, "Image analysis for digital media applications," IEEE Computer Graphics and Applications, 21(1):18-26, 2001.
• H. Yan, "Human face image processing techniques," Int'l J. Image and Graphics, 1(2):197-215, 2001.
• D. Huang and H. Yan, "Modeling and animation of human expressions using NURBS curves based on facial anatomy," Signal Processing: Image Communications, 17: 457-465, 2002.
• D. Huang and H. Yan, "Modeling of deformation using NURBS curves as controller," Signal Processing: Image Communications, 18:419-425, 2003.
• D. Huang and H. Yan, "NURBS curve controlled modelling for facial animation," Computers & Graphics, 27:373-385, 2003.
• S. Tang, A. Liew and H. Yan, "Lip-sync in human face animation based on video analysis and spline models," Proc. 10th Int'l Conf. Multimedia Modeling, Brisbane, IEEE Computer Society Press, Los Alamitos, CA, 102-108, 2004.
• J. S. S. Tang, A. W. C. Liew and H. Yan, "Human face animation based on video analysis, with applications to mobile entertainment," J. Mobile Multimedia, 1(2): 132-147, 2005.