EmbryonicAI

How ChatGPT Became So Intelligent: Unpacking the Legacy of Natural Language Processing

tldr; The development of ChatGPT is a testament to the remarkable progress made in natural language processing (NLP), a subfield of artificial intelligence. Through a series of groundbreaking innovations, NLP models have evolved from simple word counting to sophisticated systems that can understand and generate human-like language. ChatGPT is the culmination of these advancements, leveraging… Continue reading How ChatGPT Became So Intelligent: Unpacking the Legacy of Natural Language Processing

NLU: A search for a generalizable model that consistently performs well across multiple tasks

Below I attempt to paraphrase the following paper in plain in English:  Better Fine Tuning by Reducing Representational Collapse by Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, and Sonal Gupta from Facebook submitted to Arxiv on August 6th, 2020. tldr Today NLU is about leveraging pre-trained models on large datasets like RoBERTa… Continue reading NLU: A search for a generalizable model that consistently performs well across multiple tasks