Is AI Living Up to the Hype? A Retrospective Look from Industry Experts

Test Case Scenario

Send us a text

AI has made waves in testing, but how much has really changed?

In this episode of Test Case Scenario, Jason Baum, Evelyn Coleman, and Marcus Merrell take a critical look at the progress of AI in software testing. They discuss the real capabilities of tools like ChatGPT and Copilot, what’s improved over time, and what still leaves testers frustrated.
You’ll also hear insights into how AI tools are shaping software development workflows, why cost and sustainability are becoming bigger concerns, and what testers can do to separate AI hype from practical solutions.
Join us as we discuss:
(00:00) Introduction

(02:01) Evelyn’s approach to testing New Year’s resolutions

(03:47) Revisiting ChatGPT: AI’s evolution and current limitations

(05:43) The realities of AI costs and challenges in adoption

(08:11) Improvements in AI-generated content and usability

(10:53) Rediscovering AI tools for personal and professional use

(16:38) The future of AI in daily life and automation potential

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/.

▶ Sauce YouTube channel: / saucelabs

💡 LinkedIn: / sauce-labs

🐦 X: / saucelabs