Distilling the major events and challenges in the world of artificial intelligence and machine learning, from Thomas Krendl Gilbert and Nathan Lambert.
Tom and Nate sit down for a classic discussion of the role of AI in the modern philosophy of science. Much of this discussion is based on Thomas Samuel Kuhn's influential book The Structure of Scientific Revolutions. We ask -- is AI a science in the Kuhn'ian sense? Will the "paradigm" worldview apply to other sciences post AI? How will scientific institutions manage the addition of AI?We promised an AI for science reading list, so here it is:[Dario interview with Lex] https://youtu.be/ugvHCXCOmm4?si=1hnlvue8M4pV2TqCLevers for biological progress https://open.substack.com/pub/cell/p/levers?r=68gy5&utm_medium=iosX thread on theories of change in scienceshttps://x.com/AdamMarblestone/status/1845158919523664019whitepaper linked by seb krierDwarkesh physics pod https://open.substack.com/pub/dwarkesh/p/adam-brown?r=68gy5&utm_medium=ios — Nobel in physics went to aiAi policy perspectives piece A new golden age of discoveryhttps://www.aipolicyperspectives.com/p/a-new-golden-age-of-discoveryOwl posting checking recent NeurIPS papers https://www.owlposting.com/p/can-o1-preview-find-major-mistakes based on idea from Ethan Mollick https://x.com/emollick/status/1868329599438037491also another post on the subject https://open.substack.com/pub/amistrongeryet/p/the-black-spatula-project?r=68gy5&utm_medium=iosKuhn’s The Structure of Scientific Revolutionsintrinsic perspective https://open.substack.com/pub/erikhoel/p/great-scientists-follow-intuition?r=68gy5&utm_medium=iosGet The Retort (https://retortai.com/)…… on YouTube: https://www.youtube.com/@TheRetortAIPodcast… on Spotify: https://open.spotify.com/show/0FDjH8ujv7p8ELZGkBvrfv?si=fa17a4d408f245ee… on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-retort-ai-podcast/id1706223190… Follow Interconnects: https://www.interconnects.ai/… email us: [email protected]
--------
53:47
The Retort's biggest AI stories of 2024
We're back! Tom and Nate catch up after the Thanksgiving holiday. Our main question was -- what were the biggest AI stories of the year? We touch on the core themes of the show: infrastructure, AI realities, and and antitrust. The power buildout to scale out AI is going to have very real long-term impacts.Some links this week:* Ben Thompson's, The End of the Beginning: https://stratechery.com/2020/the-end-of-the-beginning/* Miles Brundage's Substack: https://milesbrundage.substack.com/p/why-im-leaving-openai-and-what-im* Stochastic Parrots paper: https://dl.acm.org/doi/10.1145/3442188.3445922Thanks for listening! Get The Retort (https://retortai.com/)…… on YouTube: https://www.youtube.com/@TheRetortAIPodcast… on Spotify: https://open.spotify.com/show/0FDjH8ujv7p8ELZGkBvrfv?si=fa17a4d408f245ee… on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-retort-ai-podcast/id1706223190… Follow Interconnects: https://www.interconnects.ai/… email us: [email protected]
--------
47:45
The Nobel Albatross
Tom and Nate catch up on the happenings in AI. Of course, we're focused on the biggest awards available to us as esteemed scientists (or something close enough) -- the Nobel Prizes! What does it mean in the trajectory of AI for Hinton and Hassabis to carry added scientific weight. Honestly, feels like a sinking ship. Some links:* Schmidhuber tweet: https://x.com/SchmidhuberAI/status/1844022724328394780* Hinton "I'm proud my student fired Sam": https://x.com/Grady_Booch/status/184414542282424329000:00 Introduction04:43 Criticism of AI-related Nobel Prize awards09:06 Geoffrey Hinton's comments on winning the Nobel Prize18:14 Debate on who should be credited for current AI advancements25:53 Changes in the nature of scientific research and recognition34:44 Changes in AI safety culture and company dynamics37:27 Discussion on AI scaling and its impact on the industry42:21 Reflection on the ongoing AI hype cycleRetort on YouTube: https://www.youtube.com/@TheRetortAIPodcastRetort on Twitter: https://x.com/retortaiRetort website: https://retortai.com/Retort email: mail at retortai dot com
--------
44:55
Claude Needs a Constitutional Convention
Tom and Nate catch up on recent events (before the OpenAI o1 release) and opportunities in transparency/policy. We recap the legendary scam of Matt from IT department, why disclosing the outcomes of process is not enough, and more. This is a great episode on understanding why the process technology was birthed from is just as important as the outcome!Some links:* Nathan's post on Model Specs for regulation https://www.interconnects.ai/p/a-post-training-approach-to-ai-regulation* Nathan's post on inference spend https://www.interconnects.ai/p/openai-strawberry-and-inference-scaling-lawsSend your questions to mail at retortai dot com
--------
42:27
Avoiding the AI burnout
Tom and Nate catch up on core themes of AI after a somewhat unintended summer break. We discuss the moral groundings and philosophy of what we're building, our travels, The Anxious Generation, AGI obsessions, an update on AI Ethics vs. AI Safety, and plenty more in between.As always, contact us at [email protected] links we mention in the episode:* The Emotional Dog and its Rational Tail https://motherjones.com/wp-content/uploads/emotional_dog_and_rational_tail.pdf* The Anxious Generation https://www.amazon.com/Anxious-Generation-Rewiring-Childhood-Epidemic/dp/0593655036* Shadow Lake Lodge https://shadowlakelodge.com/* Recent Dwarkesh Podcast https://www.dwarkeshpatel.com/p/joe-carlsmith
Distilling the major events and challenges in the world of artificial intelligence and machine learning, from Thomas Krendl Gilbert and Nathan Lambert.