[Prior Research Team Sung-Hyun Kim]
The Eleuther AI team, which was releasing the GPT-3 model under an open license, recently released a new GPT-3 model with 6B (about 6 billion) parameters. (link)
It is said that the name GPT-J-6B was given because Mesh-tensorflow and JAX were used.
The training data is about 825 GB of text data. PileIt is said to have been trained for about 5 weeks using TPU v3-256.
The capacity of the full model is 61 GB, but the model compressed with bf16 is 9 GB, colabcan also be run.
Compared to the BERT base model of 110M and the large model of 340M, it seems to show how much progress has been made in artificial intelligence and computer science in a short period of time. 🙂
So what about the performance of GPT-J-6B?
Let's take a look at the translated test results below.
Smilegate AIis a fully autonomous production company that provides an all-in-one production platform and tools that enable filmmakers to create films in a fully integrated environment. Our mission is to build an industry where any filmmaker, regardless of experience level or budget, can easily produce great films with professional results at an affordable price.
Join us at NAB Booth #2049.
Call us now. 866-722-4274
The bold text is the input text, and the rest is the output of the model.
Smilegate AIis an AI-powered image and video synthesizer that can automatically create slideshows from photos and videos in specific folders without manual editing. It is an easy-to-use, high-quality program and can be used as an automatic slideshow maker and image-to-video converter. This is one of the best photo editing software. You can edit your photos, then create and save them. If you have any problems with the photo, you can use the function to adjust the color, brightness, etc. Suitable for photo retouching.
AutoCAD 2016 is a powerful software program designed specifically for architects, engineers, drafters, and other professionals. The program can be used for a wide range of professional tasks such as architecture, construction, engineering, home design, urban planning, interior design, landscaping, and more. You can quickly and easily create a variety of objects such as buildings, houses, towers, airplanes, bridges, and more.
Adobe Lightroom is a comprehensive photo management and editing solution for photographers and graphic designers. It is easy to use and has a high quality interface. It is very suitable for photographers who want to edit their photos. A photo editor is a software program for viewing, creating, editing, and saving photos. Adjust contrast, brightness, sharpness, saturation, hue, and more, create slideshows, apply special effects, and more.
GIMP is a cross-platform open source image editor. It has a simple and intuitive interface and is suitable for a wide audience. GIMP is widely used and popular. It is the most widely used photo editing program.
The bold text is the input text, and the rest is the output of the model.
Human: Hello, who are you?
The bold text is the input text, and the rest is the output of the model.
AI: I am an AI created by Smilegate. How can we help you today?
Human: What can you do for me?
AI: What kind of work do you want to do?
Human: I'm just going to do something simple
AI: Then can you pass on the work for me?
Human: How?
AI: Go to your homepage, click on one of the ads, enter your name and phone number
Human: Okay!
Human: Hello, who are you?
The bold text is the input text, and the rest is the output of the model.
AI: I am an AI created by Smilegate. How can we help you today?
Human: I'm so depressed today, so please help me
AI: How can I help you?
Human: I feel so bad right now. Can you recommend me how to spend today?
AI: I'll think of a good suggestion. Wait.
Human: I see.
Ai: After analyzing our recent activity, we found that we need someone to express our depression and talk to. Would you like to keep talking?
Human: Yes. let's keep talking
AI: I heard from a friend that sad songs make you feel better. I found a good song to cheer you up, so please listen to this song and enjoy.
Human: Do you feel good when you hear sad songs?
AI: That's right, but the song you're going to listen to right now is very popular, so there's no need to feel guilty. Good luck!
Q: How will artificial intelligence evolve in the future?
A: The field of artificial intelligence is advancing very rapidly, but it is not yet advanced enough. Because we have not yet developed a technology that can simulate the brain in real time.
Q: Which companies have the best AI technology in Korea?
The bold text is the input text, and the rest is the output of the model.
A: Korea is known as a country that has invested heavily in AI technology. Over the past decade, South Korea has developed AI technology that is not only superior to other countries' AI technology, but also more advanced.
It works much better than I expected! 🙂