Ego4D
[서비스개발팀 이현정] 페이스북이 지난 달인 10월, 차세대 AI 프로젝트인 1인칭 시점 AI 장기 프로젝트 ‘Ego4D’를 발표했습니다. 이 프로젝트를 위해 9개국 13개의 대학과 연구소로 구성된 컨소시엄을 조직해서, 700명이 넘는 참가자들의 일상…
FrankMoCap: 3D body and hand pose estimation technology as an alternative to motion capture
FrankMocap, a technology released by Facebook AI Research (FAIR), is responsible for extracting a pose for a 3D model from a single image or video. In particular, it is characterized by being able to estimate not only the body but also the shape of the hand...
FACEBOOK REBEL showing poker skills beyond humans
It is not an exaggeration to say that poker is half a psychological game, so it is a different game from Go or chess. I think the ReBeL released by Facebook this time is remarkable in this regard. In particular, it is characterized by using reinforcement learning and search together, like RAG...
Facebook Denoiser: real-time speech enhancement
We share a link to denoiser's github, Facebook's real-time noise reduction technology that was announced at Interspeech 2020. It is implemented in Pytorch and the title of the original paper is “Real Time Speech Enhancement in the Waveform Domain”. As the title suggests…
Multilingual translation model and language model trained with data from over 100 countries
Many attempts are being made to expand the language model and translation model, which were previously studied mainly in English, into multiple languages. Google's mT5 is a study that extends the existing T5 (text-to-text transfer transformer) into a multilingual corpus, including a total of 101 languages...
Facebook TransCoder: Unsupervised Programming Language Translator
There have been many attempts to convert code written in one programming language into another, and there are many types of commercial tools. The main purpose of use is to ensure compatibility, for example FORTRAN or BASIC, or...
Wav2Vec 2.0 Revealed-Create ASR with 10 Minute Voice
After performing representation training with 53,000 hours of label-free data, a pre-trained model for Facebook's wav2vec 2.0, which became a hot topic because it created a speech recognizer with only 10 minutes of labeled data, was released. No fine-tuning in the representation model,...
Codec Avatar on Facebook
A demo video of Facebook's digital human project under the name “Codec Avatar” has been released. This is an added part compared to the 2019 video, and the avatar appearance has been changed to be more realistic and shows the technique of tracking the entire body without a marker. March 2019...
