Interaction Open Source GPT-3 Model Released, GPT-J-6B

Open Source GPT-3 Model Released, GPT-J-6B

[Priority Research Team Seonghyun Kim] The Eleuther AI team, which was releasing the GPT-3 model under an open license, recently released a new GPT-3 model with 6B (about 6 billion) parameters. (Link) It is said that the name GPT-J-6B was given because Mesh-tensorflow and JAX were used. The training data is about…