VR brings late Peking Opera legend back to life
Print Edition
AMID the melody of Jinghu, a musical instrument used in Peking Opera, an AI-powered virtual replica of Peking Opera master Mei Lanfang walked towards the center of the stage at a gentle pace holding a foldable fan.
The vivid scenes played out at the virtual avatar laboratory of the Beijing Institute of Technology. In 2020, the Central Academy of Drama in Beijing and the BIT jointly launched this public welfare research project aiming to create an interactive “digital Peking Opera artist.”
Mei Lanfang (1894-1961) was a renowned Peking Opera artist, who made major contributions to the improvement and popularization of the art form.
“Information technology and artificial intelligence were applied to create the digital version of Mei,” said Weng Dongdong, a researcher at BIT.
From face, posture, tone to clothing, props, and so on, all details revolving around a person in real life need to be digitized and visualized before replicating the subject into the virtual world.
However, it’s never easy to digitize the deceased as it is no longer possible to collect their three-dimensional data.
“We gathered a lot of relevant historical photos of Mei and turned to professionals from the Central Academy of Fine Arts for a portrait sculpture based on the pictures. Then, we scanned it with a high-precision laser scanner to secure his digital facial structure,” Weng said.
He added that the sculpture itself is short on microscopic features of skin and hair, so the team found an impersonator of Mei, and collected his facial data, captured some basic expressions, and “transplanted” them to the digital image.
“Plastic surgery experts were invited for advice so as to help obtain precision, as far as possible, in the facial replica.”
Song Zhen, director of the Center for Advanced Research on Digitalization of Traditional Drama, CAD, said the team reviewed scores of relevant documents and visited many tailoring shops in Beijing in a bid to dress the virtual image.
“We discovered that Mei’s costumes were sewn with gold thread and the technique is no longer in practice. But we managed to find cloth samples passed down from the past,” Song said, adding that with the help of experts in the Peking Opera field, the team pinpointed the most suitable clothing and scanned it for data.
Weng said they will invite Peking Opera artists to imitate Mei performing for motion captures in the future. As for the digital Mei’s voice, the research team had to recreate it through emulation as most of the existing audio-visual records of Mei have poor sound quality.
“My grandpa passed away in 1961. But with the assistance of cutting-edge technology, young people can watch his performance and know him. This is very meaningful,” said Fan Meiqiang, Mei’s grandson.
- About Us
- |
- Terms of Use
- |
-
RSS - |
- Privacy Policy
- |
- Contact Us
- |
- Shanghai Call Center: 962288
- |
- Tip-off hotline: 52920043
- 沪ICP证：沪ICP备05050403号-1
- |
- 互联网新闻信息服务许可证：31120180004
- |
- 网络视听许可证：0909346
- |
- 广播电视节目制作许可证：沪字第354号
- |
- 增值电信业务经营许可证：沪B2-20120012
Copyright © 1999- Shanghai Daily. All rights reserved.Preferably viewed with Internet Explorer 8 or newer browsers.
