bert

Dec182020

Can BERTology understand language?

The large-scale language model based on deep learning represented by BERT shows excellent performance in various tasks related to natural language such as Q&A, document summarization, document generation, and conversation. In particular, the recently appeared GPT-3 is an artificial general intelligence (AGI)...

Sep92020

KcBERT: Korean language model reflecting comments and new words

Interaction, Code, Data

In the case of large-scale language models, there was always a difficulty because there was no Korean model. Following SKT's KoBERT, Naver released KcBERT, which was learned from the ground up with data reflecting Naver comment data and new words. Not only the trained model…