The Challenge of AI Model Evaluations with Ankur Goyal

Software Engineering Daily

محتوای ارائه شده توسط Software Engineering Daily. تمام محتوای پادکست شامل قسمت‌ها، گرافیک‌ها و توضیحات پادکست مستقیماً توسط Software Engineering Daily یا شریک پلتفرم پادکست آن‌ها آپلود و ارائه می‌شوند. اگر فکر می‌کنید شخصی بدون اجازه شما از اثر دارای حق نسخه‌برداری شما استفاده می‌کند، می‌توانید روندی که در اینجا شرح داده شده است را دنبال کنید.https://fa.player.fm/legal

Species Unite

1
Trevor Ritland: The Golden Toad 34:01

14 روز پیش34:01

پخش در آینده

لیست ها

پسندیدن

دوست داشته شد

34:01

I think you could probably go back and track the stages of grief, probably that is what I went through. But I think if you do it right, you end up at acceptance. And that's where I ended up. And that's not to say that I've fully accepted the idea that the golden toad is extinct. Personally, I do still hold out hope that it could still be out there in those forests." - Trevor Ritland This conversation is with Trevor Ritland, who—along with his twin brother Kyle—authored The Golden Toad . The book chronicles their remarkable journey into Costa Rica’s cloud forest, once home to hundreds of brilliant golden toads that would emerge for just a few weeks each year—until, one day, they vanished without a trace. What began as a search for a lost species soon became something much more profound: a confrontation with ecological grief, a meditation on hope, and a powerful call to protect the natural world while we still can. Links: SpeciesUnite.com Kyle and Trevor: https://kyleandtrevor.com/ Instagram: https://www.instagram.com/adventureterm/ Goodreads - https://www.goodreads.com/book/show/222249677-the-golden-toad Amazon - https://www.amazon.com/Golden-Toad-Ecological-Mystery-Species/dp/163576996…

28 روز پیش 44:22

MP3•خانه قسمت

Evaluations are critical for assessing the quality, performance, and effectiveness of software during development. Common evaluation methods include code reviews and automated testing, and can help identify bugs, ensure compliance with requirements, and measure software reliability.

However, evaluating LLMs presents unique challenges due to their complexity, versatility, and potential for unpredictable behavior.

Ankur Goyal is the CEO and Founder of Braintrust Data, which provides an end-to-end platform for AI application development, and has a focus on making LLM development robust and iterative. Ankur previously founded Impira which was acquired by Figma, and he later ran the AI team at Figma. Ankur joins the show to talk about Braintrust and the unique challenges of developing evaluations in a non-deterministic context.

Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.

Please click here to see the transcript of this episode.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

The post The Challenge of AI Model Evaluations with Ankur Goyal appeared first on Software Engineering Daily.

1778 قسمت

#Programming #Tech #Software Development #Tech News #Open Source #Software Engineering Daily #News