JaliResearch's facial animation technology is used in Cyberpunk 2077, which will be released in late 2020 by CD PROJEKT RED studio, famous for the Witcher series. The main purpose is to allow 3D characters to make various facial expressions, and to create a natural mouth shape for multilingual voices. The following is a video released by JaliResearch.
If you go to JaliResearch's homepage, you can see an approximate approach. It uses rule-based AI, and through close integration with the existing 3D model, the entire face, such as lips, eyes, and eyebrows, is animated to create a more natural result. Do it. Compared to recent deep learning technologies taking a data-driven generation method, it is noteworthy that they are using a method based on the insights of animation experts. The following is the homepage of JaliResearch.
