This is a picture that made me feel very sad. It is a picture of Yu Gwan-soon, which remains only in low quality, restored to high-definition and added a smile, and it is said that the Faceapp with deep learning-based face editing technology was used. It is not known exactly what technology was used in Faceapp, but it seems that super resolution technology and GAN-based facial expression generation technology were applied. The following is a reference article on super resolution and GAN-based facial expression generation technology.
Pixar's Super Resolution Technology and Its Applications | Smilegate.AI
Pixar used this technique to keep costs down during the animation rendering pipeline. According to the link, it takes 50 CPU hours to render 1 frame in 2K. Assuming 24 frames per second for a 90-minute movie
GANimation-A study of creating facial expressions with one image | Smilegate.AI
It is a code repository of GANimation, a technology that creates animations that change facial expressions by inputting a single image. Basically, it is a conditional GAN, but it uses FACS (facial action coding system), a methodology for describing facial anatomical movements.
It is possible to guess what technologies were used, but it seems that the most important thing is the willingness to smile rather than the technology itself. Rather than arguing about whether the resulting product is like a real person, I think more about the kindness of wanting to give the person who sacrificed for the country a smile, even with technology. Below is a link to the original article posted on Clien.
Let's try to restore Yu Gwan-soon's photo a little more: Kleeang
Whenever I saw the pictures of Yu Gwan-soon, I felt sorry for the swollen face of torture. If you're 17 years old, you're only 4 years older than my child, but you only have a hard face like this... Let's make a little correction with the Face app and draw a picture before life. If a 100,000 won ticket comes out, I hope it will be a picture of Yu Gwan-soon smiling like this. I wish you the peace of the enthusiasm.
