EmbryonicAI

How ChatGPT Became So Intelligent: Unpacking the Legacy of Natural Language Processing

tldr; The development of ChatGPT is a testament to the remarkable progress made in natural language processing (NLP), a subfield of artificial intelligence. Through a series of groundbreaking innovations, NLP models have evolved from simple word counting to sophisticated systems that can understand and generate human-like language. ChatGPT is the culmination of these advancements, leveraging… Continue reading How ChatGPT Became So Intelligent: Unpacking the Legacy of Natural Language Processing

NLU: A search for a generalizable model that consistently performs well across multiple tasks

Below I attempt to paraphrase the following paper in plain in English:  Better Fine Tuning by Reducing Representational Collapse by Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, and Sonal Gupta from Facebook submitted to Arxiv on August 6th, 2020. tldr Today NLU is about leveraging pre-trained models on large datasets like RoBERTa… Continue reading NLU: A search for a generalizable model that consistently performs well across multiple tasks

Computers Learning to Reason

The paper End-to-end Differentiable Proving describes a break through way for computers to reason, aka learn first order logic from a knowledge base. Learning to answer questions such as what country is next to Germany or who was George Washington’s nephew? All without being explicitly programmed to do so. The technique is called Neural Theorem… Continue reading Computers Learning to Reason

Knowledge a necessary but not sufficient ingredient for artificial intelligence

Intelligence comes in many flavors from kinesthetic intelligence in the sports all star, logical processing in the math genius, or interpersonal skills found in the charismatic sales person. No matter the domain, intelligence is often measured by the information people know or what people can do. Similarly, in order for artificial intelligence to become a… Continue reading Knowledge a necessary but not sufficient ingredient for artificial intelligence