Skip to content
Smilegate.AI
Humanized AI for Entertainment Service
Smilegate.AISmilegate.AI
  • News
  • Recent
  • Popular
  • Recruit
  • Team
    • About Us
    • Research Partners
    • Smilegate AI Family
  • GitHub
  • Subscribe
Search:
  • News
  • Recent
  • Popular
  • Recruit
  • Team
    • About Us
    • Research Partners
    • Smilegate AI Family
  • GitHub
  • Subscribe

January 27, 2021

Jan272021
InteractionCode Memory optimization technology for very large models

Memory optimization technology for very large models

Interaction, Code

As the number of parameters of a deep learning model increases significantly, the memory required for training is also increasing. OpenAI's GPT-2 consists of 1.5B parameters, and Google's mT5 also has a number of parameters up to 13B. Also, the number of parameters of OpenAI's GPT-3...

Contact Us
  • E-mail:
    smilegate_ai@smilegate.com
  • Address:
    3F, Solid Space Building, 220, Pangyoyeok-ro, Bundang-gu, Seongnam-si, Gyeonggi-do
Categories
  • RFP(5)
  • NLP(19)
  • Motion(3)
  • GameAI(2)
  • RL(2)
  • Visual(72)
  • Speech(23)
  • Interaction(78)
  • Trend(149)
  • Code(55)
  • Data(25)
Popular Tags
algorithm aversion anime avatar chatbot emotion face facebook featured GAN generative Google media minecraft MixIT MRC multi-modal nvidia reinforcement learning robot segmentation self-driving car source separation speech2face speech recognition transfer learning unsupervised virtual human VR wav2vec XAI
Family Sites
  • Smilegate
  • Smilegate Megaport
  • Smilegate Foundation
  • Smilegate OrangePlanet
  • Smilegate Investment
  • Stove
© Smilegate. All Rights Reserved.

Go to Top
 Subscribe to our newsletter
 Every week, various AI-related trends, research results, and Smilegate.AI employment information are shared.
SUBSCRIBE
You can cancel your subscription at any time.
close-link