Avatarify is a program that adds real-time avatar animation functions to various video communication programs such as Zoom, Teams, Hangout, and Skype, and is open source. It is developed in the form of replacing the camera input of a video communication program, and the algorithm uses a first-order motion model.
DensePhrases is an open domain Q&A technology created by Jinhyuk Lee at Korea University, and was published as a paper titled “Learning Dense Representations of Phrases at Scale”. Here is a link to the paper: Given a question, the best paragraph from Wikipedia's nearly 60 billion paragraphs…
HuggingFace, famous for its integrated natural language processing package, adds speech recognition. The following is the related link: Specifically, Wav2Vec 2.0 developed by Facebook was added, which Wav2Vec 2.0 does unsupervised learning first with a large amount of unlabeled data, and very…
The technology to create 3D models from a single photo has been unveiled under the name MeInGame. Looking at the results uploaded to the public repository, it is not yet enough to be applied to the service without the designer's work, but it will significantly reduce the initial modeling effort…
In Kakao Brain, Pororo, an integrated natural language framework capable of responding to various natural language tasks, has been released as open source. Pororo stands for Platform Of neuRal mOdels for natuRal language prOcessing and you can think of it as a similar purpose to HuggingFace. Pororo...
Since the advent of AlexNet consisting of multiple convolution layers, there have been many studies on the structure of deep learning models. For example, Google Inception uses convolution layers with different kernel sizes, such as 3×3, 5×5, and 7×7…
As the number of parameters of a deep learning model increases significantly, the memory required for training is also increasing. OpenAI's GPT-2 consists of 1.5B parameters, and Google's mT5 also has a number of parameters up to 13B. Also, the number of parameters of OpenAI's GPT-3...
As deep learning models grow exponentially in size, it is no longer difficult to achieve usable learning times with a single machine. GPT-2, a well-known conversational model, has about 1.5B parameters and 8 million...
SuperGLUE is a challenge that evaluates the performance of AI technologies for a variety of natural language understanding tasks. It is characterized by consisting of tasks with relatively high difficulty compared to the existing GLUE, and the DeBERTa model recently announced by Microsoft achieved SOTA (state-of-the-arts) and evaluated...
