Java’s AI Evolution: Semantic Caching JVM, and GenAI Architectures with Theresa Mamarella & Brian Sam-Bodden

Modern Web

In this episode of the Modern Web Podcast, Danny Thompson, Director of Technology at This Dot Labs, hosts a conversation with Theresa Mammarella, JVM engineer at IBM, and Brian Sam-Bodden, Applied AI Engineer at Redis. They explore their talks at JCONF in Dallas, Texas, covering topics like GenAI architectures in the Java community and OpenJDK's Project Valhalla. Their conversation covers Java’s evolution, AI applications, semantic caching, and how these technologies are impacting development workflows and performance optimization.

Chapters

00:00 - Introduction

01:00 - Brian on GenAI in the Java Community

01:47 - Java’s Safe Evolution Path

02:17 - Teresa on Project Valhalla

03:54 - Value Classes and Performance

04:33 - Brian on Semantic Caching

06:54 - Challenges of Rewording Prompts

09:15 - What is RAG Architecture?

11:34 - Java’s Role in AI

13:57 - Cost of LLMs and Caching Strategies

15:57 - Teresa on Java’s Future

18:22 - Learning Resources for Java Developers

20:44 - Addressing Misconceptions About Java

22:39 - Final Thoughts

Follow Theresa Mammarella & Brian Sam on Social Media

Theresa Mammarella Twitter: https://x.com/t_mammarella?lang=en

Brian Sam-Bodden Twitter: https://x.com/bsbodden

Theresa Mammarella Linkedin: https://www.linkedin.com/in/tmammarella/

Brian Sam-Bodden Linkedin: https://www.linkedin.com/in/sambodden/