AI, Actually
Kimi, Shadow AI, Machine Learning vs. LLMs, Prompt vs. Context Engineering, and Local Models
16 Sep 2025
The AI Actually crew tackles the pressing concerns keeping enterprise leaders up at night: shadow AI infiltrating organizations, the crucial distinction between machine learning and LLMs, and why context engineering matters more than prompt engineering. Jim Johnson takes the moderator chair, joined by regular Mike Finley and special guests Andy Sweet (Advanced Models Practice Lead) and Shanti Greene (Head of Data Science and AI Innovation).Topics covered:Shadow AI: Why employees bypass IT to use personal AI toolsMachine Learning vs LLMs: Understanding when each technology winsPrompt vs Context Engineering: Moving beyond moving commasLocal vs cloud models: When ownership makes sense (and when it doesn't)Agent operations and the challenge of model stabilityThe surprising costs of AI tokens, especially for audio applicationsFollow the GangJim Johnson, AnswerRocket, Managing Partner - https://www.linkedin.com/in/jim-johnson-bb82451/ Mike Finley, AnswerRocket, CTO - https://www.linkedin.com/in/mikefinley/ Andy Sweet, AnswerRocket, VP Enterprise AI Solutions - https://www.linkedin.com/in/andrewdsweet/ Shanti Greene, AnswerRocket, Head of Data Science and AI Innovation - https://www.linkedin.com/in/shantigreene/ Chapters:00:00 Introduction to AI Actually and the Team01:59 Kimi Model Release: Should We Care?06:59 Shadow AI Definition and Enterprise Impact12:08 Leveraging Machine Learning and LLMs Together26:00 Prompt Engineering vs. Context Engineering28:13 Using LLMs to Write Prompts29:56 Memory and Agent Ops33:05 AI Literacy and Context Engineering34:27 Stability and Model Changes37:28 The Harvard MBA Analogy for AI Agents43:01 Local Open Source AI Models: Pros & Cons49:23 The Real Costs of Enterprise AIKeywords: shadow AI, machine learning vs LLMs, context engineering, prompt engineering, enterprise AI, local models, agent operations, AI costs, Kimi model, AI governance
No persons identified in this episode.
This episode hasn't been transcribed yet
Help us prioritize this episode for transcription by upvoting it.
Popular episodes get transcribed faster
Other recent transcribed episodes
Transcribed and ready to explore now
Eric Larsen on the emergence and potential of AI in healthcare
10 Dec 2025
McKinsey on Healthcare
Reducing Burnout and Boosting Revenue in ASCs
10 Dec 2025
Becker’s Healthcare -- Spine and Orthopedic Podcast
Dr. Erich G. Anderer, Chief of the Division of Neurosurgery and Surgical Director of Perioperative Services at NYU Langone Hospital–Brooklyn
09 Dec 2025
Becker’s Healthcare -- Spine and Orthopedic Podcast
Dr. Nolan Wessell, Assistant Professor and Well-being Co-Director, Department of Orthopedic Surgery, Division of Spine Surgery, University of Colorado School of Medicine
08 Dec 2025
Becker’s Healthcare -- Spine and Orthopedic Podcast
NPR News: 12-08-2025 2AM EST
08 Dec 2025
NPR News Now
NPR News: 12-08-2025 1AM EST
08 Dec 2025
NPR News Now