Danbooru 2019-Animated Character Image Data July 29, 2020 - Gather Town: Virtual space meets video meeting December 15, 2020
- Chatbot’s troubles 2021년 October 17일
- 현자의 돌 2021년 October 13일
- Pororo - KakaoBrain's Integrated Natural Language Framework February 10, 2021
News
[Jinro Concert] Reinforcement Learning and FUNFUN AI!
| A daily career mentor from current AI expert Researcher Jeong-Woo Lee! On July 12, at Daedeok Software Meister High School located in Daejeon, the students were invited to the 'Career and ...
Smilegate Membership AI Division 1st Recruitment
Smilegate Hope Studio's 'FUTURE LAB', which supports the dreams of young creators, invites you to grow together through the Smilegate Membership AI sector, a community for the growth of AI creators.
Recruitment of participants for 'Smilegate Membership' creation, AI, and social participation!
[2021-0531] Smilegate Hope Studio (Chairman Hyuk-bin Kwon) is a college student who wants young people with a passion for games and entertainment to grow into creators and to spread the creative environment of the community together…
Smilegate Group launches a large-scale public recruitment of game developers with 2021 experience!
[2021-0503] Smilegate Group, which has established itself as a global IP leader, is hiring competent game developers who will lead the future cultural contents industry together...
Smilegate Hope Studio delivers donations raised with SeAH to Haemil School
A message of hope from SeAH Story... Delivered a total of 30 million won including 24-hour donation concerts Hope Studio, game users-'Pleasant donation' with viewers of internet broadcasting
Smilegate'SeAH' challenged 24-hour relay donation concert to'make the world beautiful'
Schedule full of 24 hours from noon on the 29th… A surprise guest appearance is also announced! Full donation for broadcasting, delivered to Hope Studio... Multicultural alternative educational institution'Haemil School' IT infrastructure support...
Weekly Popular
Recruit
Hiring AI Visual Experts
Among AI fields, GAN, Style Transfer, Retargeting, etc. Visual-related technologies are widely understood, and from this, we will propose a project and lead the direction…
Hiring Android App Developers
We are looking for proactive talents with mobile app development capabilities and the ability to Fast Prototyping new ideas. Various AI technologies...
Hiring AI experts
We look for active talents who have a broad understanding of the field of AI and the latest technologies, and can propose projects and lead the direction from them. Innovative…
Service Developer Hire
We are looking for active talents who have the ability to develop new ideas in various fields and fast prototyping new ideas. Various AI technologies...
Recent Posts
Chatbot’s troubles
[서비스개발팀 한현준] 챗봇의 고민 OpenAI의 GPT-3, Google의 Meena, Facebook의 Blender 등 대형 자연어 처리 AI 모델은 인간의 언어를 실제 사람과…
현자의 돌
[융합연구팀 김무성] 최근 스탠포드의 연구자들이 “On the Opportunities and Risks of Foundation Models”라는 논문을 냈습니다 [1]. 여기서 Foundation Model이란 GPT-3와…
Gathering Strength, Gathering Storms
[Service Development Team, Yeji Cho] Dr. Eric Horvitz, former president of the Association for the Advancement of Artificial Intelligence (AAAI), an association that researches artificial intelligence in the United States, and Stanford…
Advancement of search system and utilization of NLP
[Convergence Research Team, Jihyun Song] Deep Natural Language Processing for LinkedIn Search Systems Rasa…
Artificial Intelligence AutoML for Artificial Intelligence
[Service Development Team Han Hyun-Jun] What is AutoML AutoML literally means Auto + ML, a process that automates machine learning model development tasks.…
Instruction tuning – FLAN
[Convergence Research Team Hongmae Shim] If we were to pick the top 10 keywords for 2020 in the field of NLP, of course it would be in the GPT-3 (Language Models are Few shot Learners) ranking.…
truck platooning
[Service Development Team Lee Hyeon-jeong] The Ministry of Land, Infrastructure and Transport held a presentation on the final outcome of the development of truck platooning technology on the 9th. The content of the presentation is an overall description of platooning technology, V2X-based platooning…
Virtual Influencer Trend
[Service Development Team, Eunji Kwon] The dictionary definition of an influencer is a person who influences others. With the development of today's one-person media channels, anyone can...
Translatotron 2
[Prior Research Team Hee-Jo Yoo] Translation is a topic that has been studied since the early days of the deep learning boom. Attention, which is now used in any field, is also the first to solve the problem of the Seq2Seq structure…
Can artificial intelligence become human? [planner interview]
Can artificial intelligence become human? (Interview with Eunji Kwon, Manager of Smilegate.AI Service Development Team) The AI speaker plays music that suits my mood that day. Autonomous driving...
Is autonomous driving possible without lidar?
[Service Development Team Kim Byung-in] Tesla recently decided to release radar from Model 3 and Model Y sold in North America. Since LiDAR has already been excluded, only the car...
Artificial intelligence coming to reality, Tesla AI Day
[Prior Research Team, Jeongwoo Lee] At Tesla Autonomy Day held in 2019, technology and direction were introduced with a focus on 'autonomous driving' technology. As the name suggests, this year's Tesla AI Day is a technology called 'artificial intelligence'...
Copilot, artificial intelligence that helps coding
[Prior Research Team Seonghyun Kim] The causal language model (eg GPT-3), which caused a great sensation in natural languages, has now been applied to programming languages beyond natural languages! 🤗 Last June,…
Human-like AI
[Service Development Team Cho Ye-ji] When we define AI like a normal human, we say that it is an AI that acts like a human and thinks like a human. The AI that each person expects…
Reinforcement learning aimed at AGI
[Prior Research Team Hyunwoo Choi] Last May, DeepMind published a reinforcement learning paper titled 'Reward is Enough'. The authors give examples of 'a squirrel trying to increase satiety' and 'a kitchen robot trying to maintain cleanliness'...
Droidlet: an open source platform for developing intelligent robots
[Service Development Team Jeon Jeon-jun] Facebook AI unveiled the Droidlet platform for robot development that can be used in real and virtual environments on the 28th of last month.
Managed Machine Learning Platform Vertex AI
[Service Development Team Lim Chang-dae] 'Vertex AI' was unveiled at Google's Developer Conference IO in May. Vertex AI is Google Cloud’s…
Blender 2.0 overcomes the limitations of Open Domain chatbots
[Prior Research Team Jihyun Song] It has been over 2 years since I was interested in Open Domain chatbot and came across papers on Blender 1.0 and Meena. At that time, they were...
my hand in gold
[Service Development Team Cho Ye-ji] NFT X Metaverse Since March of this year, NFT X Metaverse has been the hottest topic in technology and investment keywords. …
Multimodal Few-Shot Learner
[Prior Research Team Hongmae Shim] As super-giant language models such as GPT-3 of Open AI and Hyper CLOVA of NAVER have been released, various examples of using them recently…
MLP Singer
[Priority Research Team Hee-Jo Yoo] TTS (text-to-speech) is a technology that converts text into a voice of a specific voice when inputting arbitrary text. Since Google announced the Tacotron series…
Tensorflow VS Pytorch
[Service Development Team Hyeonjun Han] Introduction Tensorflow and PyTorch are the most popular libraries for machine learning. Developers who develop AI services or researchers studying models are initially…
Eternal light that shines upon a blameless heart
[Prior Research Team Kim Moo-seong] Eternal Sunshine Director Michel Gondry's film 'Eternal Sunshine' is a story about memories and separation between Jim Carrey and Kate Winslet as a couple.
Reinforcement learning environment for solving real-world problems
[Prior Research Team, Jeongwoo Lee] We have been using games (Go, chess, Atari games, etc.) to verify the performance of reinforcement learning algorithms for a long time. Algorithm development...
Open Source GPT-3 Model Released, GPT-J-6B
[Priority Research Team Seonghyun Kim] The Eleuther AI team, which was releasing the GPT-3 model under an open license, recently released a new GPT-3 model with 6B (about 6 billion) parameters. (Link) Mesh-tensorflow and JAX…
Handling Imbalanced Datasets
[Service Development Team Hwang Jun-sun] When supervised learning a machine learning model, when a dataset with an unbalanced number of data between labels is used as training data, it belongs to a label with a small ratio…
Learning Loss for Active Learning
[Service Development Team, Kyunghwan Lee] We usually encounter unlabeled data bundles in the process of learning a model, and often run into data annotation problems. The label…
MLOps: Continuous Deployment and Automation Pipeline for Machine Learning
[Service Development Team Lim Chang-dae] Before DevOps appeared, each company had its own server, called an on-premise server, and there were separate server administrators, developers, and QA. this…
Unity ML-Agents v2.0
[Service Development Team Jeon Jeon-Jun] ML-Agents, unveiled by Unity, is an open source tool that creates virtual characters in the game environment. Able to create game environments and work with them…
Time Series Data Analysis_TadGAN
[Prior Research Team Ji-Hyun Song] The TadGAN algorithm developed by the MIT research team has better performance than existing known models in detecting anomalies by analyzing time series data.
Can Machines Think? Emotionally
[Service Development Team, Eunji Kwon] When I was a child, when I was drawing imagination, robots in outer space were a favorite material. Looking back, in a cartoon (Galaxy Railroad 999), an artificial intelligence computer that moves a train...
[Hyper CLOVA]-Korea's first'ultra-large AI'
[Prior research team Hongmae Shim] NAVER will present Korea's first'super-large AI' Hyper CLOVA, a Korean version of GPT-3, developed by itself at the'NAVER AI NOW' online conference held on the 25th.
LaMDA-Google's Conversational Language Model
[Service Development Team Kim Byung-in] At Google I/O 2021, an event that showcases the latest Google technology, Android, Web, artificial intelligence, Chrome, and other technologies, services, and platform services...
MoveNet: A JavaScript pose estimator
[Prior Research Team Yoo Hee-jo] Pose estimation is one of the visual processing technologies that tracks the movement of characters in a video. In a way similar to a normal facial landmark...
The value of a data specialist
[Service Development Team Jeon Jeon Jeon] The digital transformation of companies accelerated by Corona 19 continues to increase the value of data. Not only professional IT companies…
Continual Reinforcement Learning
[Prior Research Team, Jeongwoo Lee] Recent reinforcement learning has shown that AI agents can overwhelm human performance in various tasks. However, the unlearned AI agent works with people...
MetaHuman Creator-Unreal Engine
[Service Development Team Byungin Kim] MetaHuman Creator is a digital human creation tool recently released by Epic Games. It looks similar to the character creation in an MMORPG game, but this real-time digital human...
Natural Language Generation Strategy in Language Models
[Prior Research Team Sung-Hyeon Kim] The latest language model is learned using a large-scale corpus. In particular, in the case of models using decoder neural networks such as GPT-2, BART, and T5 models, the following…
Lifelogging to record your daily life
[Service Development Team Eunji Kwon] Lifelogging is a word that combines Life and Log, and'As We May' contributed to the'Atlantic Monthly' by Baneva Bush, the director of the National Institute of Science and Technology in the United States in 1945. …
Graph transformer: a transformer for structured data
Transformers made to be applied to the field of natural language processing have been applied not only to text but also to various data such as images and videos.
GPT-3 based game NPC demo
Comparing the games from 10 years ago to the current games, there are a lot of differences, especially in terms of graphics. For example, 4K or higher resolution, sophisticated graphic textures,...
HyperGAN: GAN open source project for mobile phones
Most decoration apps currently running on mobile phones, such as Snow and Line Camera, extract facial landmarks and overlay previously created objects.
SPRi Metaverse Report
Metaverse, which means all forms of interaction between reality and connected avatars within a virtual environment, has recently attracted attention from various industries. Especially…
GPT-Neo: Open Source GPT-3 Project
OpenAI's GPT-3 is a large language model with a parameter count of up to 175B. Despite the amazing results that GPT-3 shows, it's not open sourced...
Applications of Graph Neural Network
Graph Neural Network (GNN) is emerging as a new field of AI. GNN is when data is expressed in a graph, which is a structure connected by a number of nodes and edges,...
ImageNet and privacy
ImageNet is a dataset that has greatly influenced the advancement of AI technology so that no one knows about AI researchers. A large number of images and about...
Analyzable control method of GAN model (GANSpace)
As a deep learning-based image generation method, GAN produces a lot of amazing results. In particular, by changing the latent vector after learning, a number of meaningful meanings...
$40M Series B of Hugging Face
It is news that Hugging Face, famous for its deep learning-based natural language processing open source, has attracted a $40M Series B investment. Hugging Face Transformer is probably a natural language...
A collection of AI projects for mobile devices (Awesome Tensorflow Lite)
Tensorflow Lite is a software package that contains tools that allow AI models trained with Tensorflow to run on mobile devices. Currently 4 billion...
Jina - open source multi-modal search engine based on deep learning
Jina, which is open sourced by Jina.AI, is a multimodal data search engine using deep learning technology. Not only some functions for search are implemented, but in the service...
Artificial Intelligence and Games (Book)
The latest AI technologies based on deep learning are being actively introduced in various fields such as speech recognition, speech synthesis, translation, chatbots, and smart factories, but games...
Google Lyra - speech compression based on deep generative models
Google Lyra is a new speech compression method based on the generative model. Existing speech compression methods achieve the original level of sound quality, that is, transparent quality...
AI market size in 2021 is predicted to be about $328B (IDC)
IDC, renowned for its market analysis in various sectors, has published predictions about the size of the AI market. Below is the relevant link: According to the announcement, in 2021…
Avatarify - Add real-time avatar to video communication
Avatarify is a program that adds real-time avatar animation functions to various video communication programs such as Zoom, Teams, Hangout, and Skype, and is open source. Camera of video communication program...
DensePhrases - Near-Real-Time Wikipedia Open Domain Q&A
DensePhrases is an open domain Q&A technology created by Jinhyuk Lee at Korea University, and was published as a paper titled “Learning Dense Representations of Phrases at Scale”. Here is a link to the paper:…
Framework merging of natural language processing and speech recognition
HuggingFace, famous for its integrated natural language processing package, adds speech recognition. The following is the related link: Specifically, Wav2Vec 2.0 developed by Facebook was added, Wav2Vec…
MeInGame-Create 3D models from photos
The technology to create 3D models from a single photo has been unveiled under the name MeInGame. Looking at the results posted on the public repository, the designer's work...
PapersWithCode's Korean dataset
Paperswithcode provides information on various papers in the field of AI, linked open sources, and SOTA, with links to over 3,000 useful datasets...
Pororo - KakaoBrain's Integrated Natural Language Framework
In Kakao Brain, Pororo, an integrated natural language framework capable of responding to various natural language tasks, has been released as open source. Pororo is the Platform Of neuRal mOdels for natuRal…
Ubuntu Dialog Corpus
Building a dialogue system that allows humans to have natural-feeling conversations with virtual agents is a difficult task in natural language processing, and a lot of ongoing research...
Digital Twin + AI
Digital Twin means moving an object or environment that has a substance in the real world into a virtual space and linking the two. Simply put…
RepVGG: a new interpretation of the Residual Network
Since the advent of AlexNet consisting of multiple convolution layers, there have been many studies on the structure of deep learning models. For example, Google Inception is 3×3,…
Memory optimization technology for very large models
As the number of parameters of a deep learning model increases significantly, the memory required for training is also increasing. OpenAI's GPT-2 consists of 1.5B parameters, and Google's mT5 is also in 13B...
Distributed training framework: Horovod and RaySGD
As deep learning models grow exponentially in size, it is no longer difficult to achieve usable learning times with a single machine. Well-known conversation...
Five brain functions to consider in AI research
It is true that the field of AI has made a lot of progress, but there are still many shortcomings compared to humans. What if the ultimate goal of AI is the human brain...
OpenAI DALL-E: Creating images from text
DALL-E, released by OpenAI, is a technology that generates images from natural language text. Previously, there were technologies for the same purpose such as StackGAN and OP-GAN, but DALL-E is a very large language model...
DeBERTa: surpass human performance in SuperGLUE
SuperGLUE is a challenge that evaluates the performance of AI technologies for a variety of natural language understanding tasks. It is composed of tasks with relatively high difficulty compared to existing GLUE...
What is the next step of AI in 2021?
Since deep learning began in earnest in 2012, AI technology has surpassed the performance of existing technologies in many fields. Although it is a limited environment...
Open-domain chatbot 'Luda' parenting diary: record from birth to close-beta
“Luda” of Scatterlab (https://scatterlab.co.kr/), whose official version was recently released, is an open domain chatbot learned based on billions of KakaoTalk conversation data. Anyone can chat through Facebook messenger. …
Technology to diagnose Alzheimer's with verbal information
Dementia is a phenomenon in which the brain function is greatly degraded to the point that it interferes with daily life. Alzheimer's is the most responsible for 60%-80% among dementia...
Open source chatbot frameworks: Kochat, Rasa, Rocket Chat
KoChat is a Korean open source chatbot framework released by Hyunwoong Ko. Here is the KoChat github repository: When we talk about chatbots, we often only think of the conversation model, but in fact…
FrankMoCap: 3D body and hand pose estimation technology as an alternative to motion capture
FrankMocap, a technology released by Facebook AI Research (FAIR), is responsible for extracting a pose for a 3D model from a single image or video. In particular, the body…
Digital Human Platform Companies
The Digital Human Platform is a form that combines various AI technologies with an avatar with a humanoid appearance. Thanks to advances in AI dialogue technology and visualization technology...
AI trends and game application examples
This is a report that summarizes AI trends and cases of AI technology application by game companies. The approximate table of contents is as follows: AI is… AI market and major…
Korean profanity text dataset
We share a set of Korean profanity data collected and labeled by Joonhee Jo. It is gathered from multiple communities, and seems to be suitable for evaluation of real-world data. Below is...
Can BERTology understand language?
The large-scale language model based on deep learning represented by BERT excels in various tasks related to natural language such as Q&A, document summary, document generation, and conversation...
Gather Town: Virtual space meets video meeting
Gather Town is a kind of video meeting solution such as Zoom or Teams, but it is characterized by actively introducing virtual space and avatars. For example, a virtual space called “Office”…
UnifiedQA: A single model responds to multiple Q&A tasks
QA Tasks that generate appropriate answers to a given question have seen a lot of performance gains due to recent deep learning technologies. The well-known SQuAD is also...
Techniques for generating questions from paragraphs
A problem commonly referred to as a Q&A task is to learn from a data set recorded in pairs of questions and answers so that when a question is asked, an appropriate answer comes out...
POSTECH STUDIOGAN: GAN algorithm library
StudioGAN is a pytorch-based open source library released by Pohang University CVLab Kang Min-guk, and various GAN algorithms are implemented. Included GAN algorithms include DCGAN, LSGAN, WGAN…
FACEBOOK REBEL showing poker skills beyond humans
It is not an exaggeration to say that poker is half a psychological game, so it is a different game from Go or chess. ReBeL released by Facebook this time is remarkable in this respect...
MELD: Multimodal EmotionLines Dataset
Multimodal EmotionLines Dataset (MELD) is a multimodal extension of EmotionLines, an emotionally labeled dialogue data set. MELD is what EmotionLines can use...
JALI's face animation technology used in CYBERPUNK 2077
Cyberpunk 2077, set to launch in late 2020 by CD PROJEKT RED studio, famous for the Witcher series, uses JaliResearch's facial animation technology. The main purpose is 3D…
MindMeld Conversational AI Platform
MindMeld is an open source interactive AI platform designed to ensure serviceable quality. Written in Python, the latest NLP skills and knowledge…
STATE OF AI REPORT 2020
This is the State of AI Report 2020, a report that analyzes various changes in the AI field. This report is with AI investor Nathan Benaich...
Improved NPC AI of The Division 2
Division 2 is an online action RPG developed by Massive Entertainment and published by Ubisoft, set in Washington, DC, where smallpox is popular. Gamers with government agents...
Avatar technology entering the K-POP market
Avatar has been used in various forms such as SNS, customer response, and character expression in games long before the advent of AI technology.
Unity ArtEngine
Unity's ArtEngine is a tool that makes it easy to create high-quality graphic resources using AI-based technology. In Unity, these technologies are called AI-assisted artistry...
Facebook Denoiser: real-time speech enhancement
We share a link to denoiser's github, Facebook's real-time noise reduction technology that was announced at Interspeech 2020. It is implemented in Pytorch and the title of the original paper is “Real Time…
AI market size compared to smartphones
According to the IDC forecast report, the AI market size in 2020 is predicted to be about 157B$. Of course, this number is in various industries related to AI, namely...
Video QA – 3D Attention is All You Need
Typically, Q&A systems use text to answer questions. With this type of task, you give a paragraph explaining a fact, ask a question, and give an appropriate answer...
UneeQ launches digital human platform
UneeQ has launched a digital human platform called Digital Human Creator. Although the service price is a bit burdensome, we offer a free trial, so we do a simple test…
VIBE: predicting 3D human model parameters from images
In order to implement the visualization part of Human-Like AI, it is necessary to think about how to create and move 3D human models, but various existing approaches are…
Multilingual translation model and language model trained with data from over 100 countries
Many attempts are being made to expand the language model and translation model, which were previously studied mainly in English, into multiple languages. Google's mT5 is the original T5 (text-to-text…
AI technology that predicts Covid-19 infections through cough sounds
Corona 19 has yet to show signs of calming down worldwide. MIT has created an AI model that can check whether COVID-19 is infected from the cough sound recorded with a mobile phone...
Adobe Neural Filter: Changing the image editing paradigm
Adobe announced an AI-based editing tool called neural filter. Some say it's already included in the latest version of Photoshop. In the example function, the picture...
AI trends in media compression by four events in 2020
2020 is likely to be the first year for the application of AI technology in the field of media compression to be considered in earnest. Here's a brief look at the four events that took place this year…
Conversation design for open domain chatbots
On the Ping-Pong blog, there was an article titled "Conversation composition of Luda dreaming of a superhuman AI", but there are a number of parts to be considered when designing an open domain chatbot...
Bluetooth-based COVID-19 risk group identification technology
There are a number of studies related to Corona 19 using AI technology. The paper shared below is a study by Fraunhofer HHI published in Nature, from Bluetooth Low Energy (BLE)…
NVidia Maxine: AI-based video communication platform
NVidia unveiled a cloud-based video communication platform called Maxine. Maxine's feature is the full introduction of AI technology, specifically facial images such as H.264...
Super resolution and facial expression of Gwan-soon Yu's old photo
This is a picture that made me feel very salty. The picture of Yu Gwan-soon, which remains only in low quality, is restored in high quality and added with a smile. Deep learning-based face editing technology...
Vid2Player: video analysis-based tennis player motion generation
There seem to be a lot of technologies recently to create new motions by extracting motion from human motion. (vid2vid, vid2game, pose2pose) Vid2Player was researched at Stanford University,...
MEAL v2: Achieving ImageNet Top-1 80% with ResNet-50
When multiple network models are combined into an ensemble, performance increases. Since the total network size and inference time also increase, it is difficult to apply it in practice.
HuggingFace Datasets 1.0
The first stable version 1.0 of the Huggingface Datasets library has been released, making it easy to use NLP datasets and evaluation metrics. Now…
Scalable character animation based on reinforcement learning
It is natural to see virtual characters and moves reasonably in terms of the laws of physics, that is, human-like.
Wav2Lip: generate lip motion from voice
LipGAN is a technology that generates the shape of the lips of a face image using a voice signal, and when it is actually applied to a video, it is somewhat regrettable in terms of visual artifacts and naturalness of movement...
NLP acceleration with HuggingFace and ONNX Runtime
The performance improvement shown by Transformer-based language models is surprising, but as the model size increases exponentially, concerns about service costs are also becoming important. Bert-base or GPT-2…
Korean language corpus of National Institute of Korean Language
The National Institute of the Korean Language has released Korean language materials for artificial intelligence learning on a large scale (13 kinds of 1.8 billion words). It was built by solving the copyright problem, and created an online agreement on the'Everyone's Corpus' site,…
Super-human AI for Gran Turismo
The link is a review of a paper published by Sony and ETH Zurich, which exceeds human records by applying reinforcement learning to the famous car game Gran Turismo...
GPT-3 examples and minGPT project
Scatterlab (https://scatterlab.co.kr/), which is prominent in everyday conversational research, is an article on the Ping-Pong team blog.
Generation code of Lee Malnyun webtoon style faces
bryandlee's github has the results of image translation application using deep generative model and related research made into a webcomic in the late years of calm man. Research title...
Facebook TransCoder: Unsupervised Programming Language Translator
There have been many attempts to convert code written in one programming language into another, and there are many types of commercial tools.
Performance analysis of human and AI for image classification
Imagenet-1K (1000 class image classification problem) is a task that has been optimized with the development of CNN. AlexNet's TOP-5 error that announced the beginning of the deep learning era is about…
Necessity of interaction with AR Glass concept video
This is an AR Glass concept video created by a designer named Iskander Utebayev. Considering the concept video, it is quite fancy and once implemented, the Human-Machine Interface using smart devices...
Lip2Wav: Generates a voice signal from silent lip movement
I've heard stories that you can know what you're talking about with just the movement of your lips if you get special training.
KcBERT: Korean language model reflecting comments and new words
In the case of a large-scale language model, there was always a difficulty because there was no Korean model. Following SKT's KoBERT, Naver comment data, new words, etc...
Pixar's Super Resolution Technology and Its Applications
Deep learning-based super resolution technology was adopted under the name DLSS (deep learning super sampling) in NVidia's latest GPU, and it has become a technology that is actually serviced to consumers.
Implementation feasibility with Google MixNet
The convolution commonly used in images is a 3D operation. (KxKxC; K=kernel size, C=number of channels) After applying this by dividing it into multiple 2D operations of KxKx1, 1x1xC in the channel direction...
Creating body movements by voice
LipGan is the study of creating mouth shapes from speech signals. It is a technique that can be usefully used to create a virtual character's mouth animation, but when applied in practice...
Microsoft Teams Together mode
As non-face-to-face video meetings have become commonplace in recent years, more and more people use Zoom to conduct multi-person video conferences. A phenomenon called zoom fatigue is also attracting attention...
H.266/VVC standard and deep learning technology
An international standard for a new video codec named (ISO MPEG) VVC or (ITU-T) H.266 has been released. Share related articles. Deep learning technology...
AI Fall or Renaissance
According to various statistics, the number of AI-related major conference participants increased 6 times over 5 years, and the number of AI startups was 28% for 4 years…
Multimodal Q&A – Visual Dialog Task
The Visual Dialog task is a multimodal task that adds an image to a Q&A task that consists of a question and answer. For example, a white cat and a black dog together...
AI and human collaboration: a new collective intelligence
Share what you've recently enjoyed reading. In this article, humans and AI do well in different fields, and rather than one side replacing the other...
Motion Retargeting from Motion, Skeleton and Angle
We share the project page of “Learning Character-Agnostic Motion for Motion Retargeting in 2D”, the paper published at SIGGRAPH 2019. This paper (which can be different)…
Adobe Mixamo: 3D character model open data
In the game production side, we share a link to the Adobe Mixamo site that is already used a lot. When you enter, 121 3D characters and 2484 character motions come up...
FastSpeech2 Open Source
TensorflowTTS, an open source based on Tensorflow 2 that supports several latest TTS models such as Tacotron2, MelGan, FastSpeech, etc., has finally begun supporting Microsoft FastSpeech2. FastSpeech2 is a Transformer…
AI: Intelligence vs. Automation
Links are articles that cause a lot of concerns about the difference between Intelligence and Automation. Artificial Intelligence is known as a term that came into use when neural networks appeared in the 1960s...
Emotion recognition reflecting facial expressions and body movements
There have been various attempts to recognize emotions from images or images. It is provided in the cloud API and is known so much that it becomes a topic on SNS (joy 95%, etc.).
GAN-based Image Compression
In the field of video compression, there are also things like Moore's Law (the number of transistors doubles every two years), MPEG-1 in 1993, MPEG-4/AVC (H.264) in 2003, MPEG-H/HEVC in 2013 ( H.265)...
Text-to-SQL: Convert natural language to SQL
Text-to-SQL is a task that automatically converts natural language into SQL. The post I shared at the bottom was written by Aerin Kim of Microsoft, and it is well organized about Text-to-SQL.
Introducing NVidia Ampere Architecture
When learning deep learning algorithms, GPU is considered essential, but when serving after model training is complete, CPU is used instead of GPU...
Speech2Face-face prediction from speech signals
MIT's Speech2Face is a study that generates a speaker's face from a speech signal. However, it is not that speech to face transform is performed with one model, and it is an existing model for other purposes...
Google MixIT AI-Separation of unsupervised learning sound sources
MixIT AI, released by Google, is a technology that obtains a separate sound source from single-channel audio in which multiple sound sources are mixed. It can be viewed as a blind source separation task...
Algorithm aversion and explainable AI
In the field of prediction, Algorithm Aversion means that when you realize that an algorithm can make mistakes, you tend not to use it even if it is superior to human predictions...
Wav2Vec 2.0 Revealed-Create ASR with 10 Minute Voice
Facebook's wav2vec, which became a hot topic because it made a speech recognizer with only 10 minutes of labeled data after representation training with 53,000 hours of label-free data.
MIT DriveSeg-data for road situation awareness research
It is a dataset DriveSeg created for research on road situation awareness (used for self-driving cars, etc.). For each frame of the video, the entire image is pixel-by-pixel semantic labeling…
Introduction of autonomous vehicle technology and social consensus
Although it is a little leap forward, if you consider the addition of physical devices to AI algorithms as intelligent robots, the intelligent robot that will be most popular in the future is...
Human brain vs. AI-Hardware Comparison
One of the recent trends is the super-giant model, i.e. the enormous increase in the number of parameters and the application of traditional learning methods. The “software capability” of the human brain…
Machine reading comprehension (MRC) task and data set arrangement
Many MRC models proposed so far show evaluation values beyond human capabilities in various tasks and datasets, but better than humans for a given context...
IBM's emotional robot Nao-mi
This is a video of IBM's emotional robot Nao-mi. [Summary of Contents] A robot that says he doesn't want to do with a person who asks to destroy a tower that has been difficult to build. To the continual demand...
Transfer Learning becomes a necessity, not an option
The learning cost of GPT-3, a pronoun of the super-scale language model, which showed the possibility that it can be applied to all natural language tasks only with Few shot learning, is about Hanwha...
First Order Motion Model for Image Animation
Los Angeles Noir, a 2011 film made by Rockstar, surprised many with facial animations that were far superior to other games. The technology used at this time...
The phenomenon of knowledge unindex by YouTube's advancement
With the advent of digitalization and the advent of the Internet and the web, knowledge is distributed and stored on servers around the world, connected to each other, and made searchable, so that accessibility and usability are dramatically improved. Books…
Codec Avatar on Facebook
A demo video of Facebook's digital human project under the name “Codec Avatar” has been released. This is an added part compared to the 2019 video, and the avatar looks more realistic...
GANimation-A study of creating facial expressions with one image
It is a code repository of GANimation, a technology that creates animations that change facial expressions by inputting a single image. Basically, it is conditional GAN, to describe the anatomical movement of the face...
Virtual Human: Saya Project
Japan's Virtual Human Project, Saya Project. It's in Japanese, so I couldn't understand all the progress, but the visual completion was quite high and the expression was natural. after…
Danbooru 2019-Animated Character Image Data
Introducing the Danbooru 2019 version link, an animated character image database. There are about 3.7 million images and about 29 tags are attached per image. Tag's…
Apple's ultra-high resolution VR headset (iGlass?)
Assuming that the human-like AI-equipped humanoid character has improved tremendously, display it on a 2D plane such as a computer or smartphone screen, and use a mouse, keyboard, and touch...
RAVDESS-Multimodal Sentiment Data
There are many co