I recently read about the relationship between human abilities and neural networks. Although it appears in the article, the way the human brain and neural networks operate have similar corners, but I don't think they need to be the same. Rather than imitating fish to swim, you can build a submarine, and make an airplane rather than imitate a bird to fly. (This is the author's example)
In the article, human memory characteristics were classified into episodic memory (past experience), working memory (context, information combination), attention (concentration, ignorance), and transfer learning (transfer learning). Do it. Episodic memory is reinforcement learning, working memory is a recurrent neural network, attention and transfer learning are each information isolation technique and fine tuning.
Even humans use all of the above features comprehensively. It is still unclear whether all of these synthetic characteristics can be shown in a single network, but the possibility seems to be evident when we look at GPT-3, which recently attempts to solve multiple tasks with one model. I wonder if the large flow chart of AI research will go in the direction of contemplating how to converge and integrate unit technologies unlike until now, when evaluating the recognition rate of a specific task.
