- Easy Cloud Solutions
- Posts
- ‘Model collapse’: Scientists warn against letting AI eat its own tail
‘Model collapse’: Scientists warn against letting AI eat its own tail
Jacqueline Choi
August 12, 2024
Welcome, AI enthusiasts.
|
What's in this week's issue?
🦎 ‘Model collapse’: Scientists warn against letting AI eat its own tail
🔎 With Google in its sights, OpenAI unveils SearchGPT
⛅️ Easy Cloud News
📰 AI News
🧰 AI Tools
Generated by Midjourney
In a paper published in Nature, British and Canadian researchers led by Ilia Shumailov at Oxford show that today’s machine learning models are fundamentally vulnerable to a syndrome they call “model collapse.” As they write in the paper’s introduction:
We discover that indiscriminately learning from data produced by other models causes “model collapse” — a degenerative process whereby, over time, models forget the true underlying data distribution …
AI models are pattern-matching systems at heart: They learn patterns in their training data, then match prompts to those patterns, filling in the most likely next dots on the line.
Whether you ask, “What’s a good snickerdoodle recipe?” or “List the U.S. presidents in order of age at inauguration,” the model is basically just returning the most likely continuation of that series of words.
Generated by Midjourney
OpenAI may have designs to get into the search game — challenging not only upstarts like Perplexity, but Google and Bing, too.
The company on Thursday unveiled SearchGPT, a search feature designed to give “timely answers” to questions, drawing from web sources.
UI-wise, SearchGPT isn’t too far off from OpenAI’s chatbot platform ChatGPT. You type in a query, and SearchGPT serves up information and photos from the web along with links to relevant sources, at which point you can ask follow-up questions or explore additional, related searches in a sidebar.
Easy Cloud News
AI News
🇰🇷 Nvidia supplier SK Hynix to build $6.8 billion chip plant in South Korea (link)
⭕️ Level AI applies algorithms to contact center pain points (link)
🤖 Former Tesla humanoid head launches a robotics startup (link)
⛈️ Google creates AI weather simulator that measures climate change (link)
💸 Cohere raises $500M to beat back generative AI rivals (link)
AI Tools
This newsletter is powered by Beehiiv