Machine Learning Street Talk (MLST)

#046 The Great ML Stagnation (Mark Saroufim and Dr. Mathew Salvaris)

06 Mar 2021

Audio

Description

Academics think of themselves as trailblazers, explorers — seekers of the truth. Any fundamental discovery involves a significant degree of risk. If an idea is guaranteed to work then it moves from the realm of research to engineering. Unfortunately, this also means that most research careers will invariably be failures at least if failures are measured via “objective” metrics like citations. Today we discuss the recent article from Mark Saroufim called Machine Learning: the great stagnation. We discuss the rise of gentleman scientists, fake rigor, incentives in ML, SOTA-chasing, "graduate student descent", distribution of talent in ML and how to learn effectively. With special guest interviewer Mat Salvaris. Machine learning: the great stagnation [00:00:00] Main show kick off [00:16:30] Great stagnation article / Bad incentive systems in academia [00:18:24] OpenAI is a media business [00:19:48] Incentive structures in academia [00:22:13] SOTA chasing [00:24:47] F You Money [00:28:53] Research grants and gentlemen scientists [00:29:13] Following your own gradient of interest and making a contribution [00:33:27] Marketing yourself to be successful [00:37:07] Tech companies create the bad incentives [00:42:20] GPT3 was sota chasing but it seemed really... "good"? Scaling laws? [00:51:09] Dota / game AI [00:58:39] Hard to go it alone? [01:02:08] Reaching out to people [01:09:21] Willingness to be wrong [01:13:14] Distribution of talent / tech interviews [01:18:30] What should you read online and how to learn? Sharing your stuff online and finding your niece [01:25:52] Mark Saroufim: https://marksaroufim.substack.com/ http://robotoverlordmanual.com/ https://twitter.com/marksaroufim https://www.youtube.com/marksaroufim Dr. Mathew Salvaris: https://www.linkedin.com/in/drmathewsalvaris/ https://twitter.com/MSalvaris

Transcription

This episode hasn't been transcribed yet

Help us prioritize this episode for transcription by upvoting it.

0 upvotes

🗳️ Sign in to Upvote

Popular episodes get transcribed faster

Other episodes from Machine Learning Street Talk (MLST)

Transcribed and ready to explore now

Abstraction & Idealization: AI's Plato Problem [Mazviita Chirimuuta]

23 Jan 2026

Machine Learning Street Talk (MLST)

Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]

23 Jan 2026

Machine Learning Street Talk (MLST)

Adversarial Examples and Data Modelling - Andrew Ilyas (MIT)

22 Aug 2024

Machine Learning Street Talk (MLST)

View all episodes from Machine Learning Street Talk (MLST)

Comments

There are no comments yet.

Please log in to write the first comment.

Report any issue

Machine Learning Street Talk (MLST)

#046 The Great ML Stagnation (Mark Saroufim and Dr. Mathew Salvaris)

This episode hasn't been transcribed yet

Other episodes from Machine Learning Street Talk (MLST)

Abstraction & Idealization: AI's Plato Problem [Mazviita Chirimuuta]

Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]

Adversarial Examples and Data Modelling - Andrew Ilyas (MIT)

Sign in to Audioscrape

Share this moment