Avatarify is a program that adds real-time avatar animation functions to various video communication programs such as Zoom, Teams, Hangout, and Skype, and is open source.
It is developed in the form of replacing the camera input of a video communication program, and the algorithm uses a first-order motion model as below link.
You can easily see what the code is doing by looking at the action screen below.
Image conversion using StyleGAN is also used, so it will be highly customizable. However, a somewhat higher hardware specification is required for smooth use, and the following is the performance of the released hardware specifications.
- GeForce GTX 1080 Ti: 33 frames per second
- GeForce GTX 1070: 15 frames per second
- GeForce GTX 950: 9 frames per second
It supports Linux, Mac, and Windows, and although it is a slightly different version, an APK for Android phone is also made.
There are many similar AI algorithms, but there are few forms combined with actual video communication programs, so it seems to be very helpful when implementing actual services.