In this conversation, Richard and Vernon delve into the evolving landscape of AI, particularly focusing on the concept of agentic AI. They discuss personal updates, including their health and fitness journeys, before transitioning into a detailed exploration of AI technologies. Richard shares his recent experiences with AI training and projects, emphasizing the differences between traditional generative AI and agentic AI.The discussion highlights the importance of goals, tasks, and tool awareness in AI, drawing parallels to software testing and the dynamics of generalists versus specialists in the tech industry. The conversation concludes with reflections on the implications of these technologies for the future. In this conversation, Vernon and Richard explore the evolving landscape of AI, particularly focusing on agentic AI and its implications for testing and quality assurance.They discuss the importance of defining clear goals and expected outcomes for AI tasks, the need for quality characteristics in AI outputs, and the critical role of human oversight in AI decision-making. The conversation also touches on iterative learning, exploratory testing, and the future of AI in the testing domain, emphasizing the necessity for testers to adapt and enhance their skills in this rapidly changing environment.Links to stuff we mentioned during the pod:02:40 - Ben KellyBen's LinkedInBen's IMDb06:38 - Martin Hynie's video explaining Agentic AIBe sure to check out the resources he shared in the comments too. Goodness gracious 🎯12:19 - CrewAI the tool Rich was experimenting with13:27 - And for funsies we asked ChatGPT the same question17:52 - Jason ArbonJason's websiteJason's LinkedIn23:23 - Persona-based testing24:11 - Context-driven testing01:08:43 - Other folks & materials you can learn fromThe deeplearning.ai websiteTariq KingHere's what Perplexity came up with!His workshop: An Introduction to AI-Driven Test AutomationHis presentation: Integrating GenAI for Testing into the Software LifecycleTariq's LinkedInMelissa EadenMel's newsletterThe issue called is "A Fable about GenAI" is excellentMel's LinkedInMark WinteringhamMark's websiteMark's GenAI bookMark's LinkedInMartin HynieMartin's newsletterThe series "So You Just Got Assigned Your First GenAI Project" is goldenMartin's LinkedInGo to his profile. Find the "Activity" section. Use the "Videos" link/button to filter his posts. Watch the videos. Thank me later.Bill MatthewsBill's LinkedIn00:00 - Intro01:14 - Welcome04:02 - Rich's adventures learning about AI05:24 - Rich goes down the Agentic AI rabbit hole07:00 - GenAI vs Agentic AI12:45 - Understanding Agentic AI vs. Traditional AI13:27 - What's the difference between the term "Agent" and "Agentic"?15:20 - How would Rich describe or categorise a chatbot?16:15 - What makes something agentic then?17:52 - Jason helps Rich understand what to expect from his exploration18:51 - What's the relationship between goals and tasks?20:06 - Rich explains what makes this so interesting for him and got him excited26:12 - Empowering Agents with the Right Tools27:47 - Understanding Tasks vs. Goals28:45 - Breaking Down Tasks for Efficiency29:44 - How much agency do agents have?31:38 - Task Descriptions and Expected Outcomes33:03 - Teams of agents vs teams of people and specialists vs generalists35:48 - How does an agent decide what to do next and how does it know it has completed the task?36:40 - Defining Quality in Agent Outputs38:15 - MOAR testing concepts that have parallels with Rich's exploration40:28 - The consequences of not being accurate enough with your backstory, expected output, tasks, etc43:34 - What happens when agenticai is asked to achieve the same goal without changing anything about the backstory, expected output, tasks, etc?45:40 - Challenges of Iteration and Learning46:47 - What are max iterations and what does that remind Rich of?47:40 - Vern wonders how important semantics is going to be and how Testers can contribute to this work49:42 - Rich riffs on exploratory testing51:02 - Exploratory Testing and Agentic Learning. What does the Tester's story look like in the context of an agentic system from the agent's perspective?54:15 - Exploring Autonomy in AI Systems56:57 - Evaluating AI Outputs and Task Design58:21 - What happens if/when the context is left blank in these agentic systems?01:00:49 - Soooo where do the humans fit in if agentic systems can doAllTheThings?01:02:37 - Wrap up: Take 1 - Designing small targeted tests vs designing small targeted tasks01:04:46 - Wrap up: Take 2 - Agents delegating tasks to other agents. Er... WTF?!01:06:00 - Wrap up: Take 3 - How is Rich feeling about AI & AI tools?01:09:45 - Wrap up: Take 4 - Testers ASSEMBLE! How we're going to contribute in a world of AI

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Transcript

Related