tldr; The development of ChatGPT is a testament to the remarkable progress made in natural language processing (NLP), a subfield of artificial intelligence. Through a series of groundbreaking innovations, NLP models have evolved from simple word counting to sophisticated systems that can understand and generate human-like language. ChatGPT is the culmination of these advancements, leveraging… Continue reading How ChatGPT Became So Intelligent: Unpacking the Legacy of Natural Language Processing
Below I attempt to paraphrase the following paper in plain in English: Better Fine Tuning by Reducing Representational Collapse by Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, and Sonal Gupta from Facebook submitted to Arxiv on August 6th, 2020. tldr Today NLU is about leveraging pre-trained models on large datasets like RoBERTa… Continue reading NLU: A search for a generalizable model that consistently performs well across multiple tasks
The paper End-to-end Differentiable Proving describes a break through way for computers to reason, aka learn first order logic from a knowledge base. Learning to answer questions such as what country is next to Germany or who was George Washington’s nephew? All without being explicitly programmed to do so. The technique is called Neural Theorem… Continue reading Computers Learning to Reason
Mark Rodgers used to work in the oil fields connecting large pipes together. According to this Bloomberg article, his job was recently replaced by a robot, the Iron Roughneck. The machine helps tie together pipes and is becoming better with each generation. Beyond manual labor, many white collar jobs are being improved with AI powered… Continue reading 10 skills which will thrive in the coming AI powered robot revolution
Intelligence comes in many flavors from kinesthetic intelligence in the sports all star, logical processing in the math genius, or interpersonal skills found in the charismatic sales person. No matter the domain, intelligence is often measured by the information people know or what people can do. Similarly, in order for artificial intelligence to become a… Continue reading Knowledge a necessary but not sufficient ingredient for artificial intelligence
Have you ever showed up to a meeting where everyone has a different answer to the same question? Imagine a marketing manager, let’s call her Mary, who shows up to a meeting convinced that her new e-marketing campaign will generate a 10% improvement in the conversion rate. While her counterpart Suzie from the sales team… Continue reading One reason your machine learning project will fail before it starts
Have you ever thought to yourself? Why do I need to do this tedious task over and over again? Shouldn’t the software do this for me? Can’t this be automated? Let’s take a moment to consider what the Return On Investment (ROI) could be for building software to do that task? Software is all around… Continue reading Is your app idea worth building?
It is estimated that more than 40% of current jobs are likely to be automated within the next 10-20 years (see robot job automation). This means potentially 40% higher profits for businesses that are able to adopt these automation opportunities. This will result in a drastic shift in our economy, requiring many people to be… Continue reading Can Artificial Intelligence help end global poverty?
What if Artificial Intelligence took the time to close on a home purchase from 30 to 3 days? Artificial Intelligence has tremendous power to increase economic output. Take a look around and consider the inefficiencies in modern businesses? How much time is spent on tedious paperwork? How many hours are lost in endless meetings? Imagine… Continue reading Imagine if AI could decrease the time to buy a home from 30 days to 3 days?
When I started my career in the semiconductor industry, I was elated by all the amazing technology from fast moving robots to ion accelerators which bring atoms to a percent of the speed of light. Part of my job was writing new “recipes” that, much like a cooking recipe, specified what the settings the machine… Continue reading Free yourself from tedious tasks at work
