Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
محتوای ارائه شده توسط Igor Melnyk. تمام محتوای پادکست شامل قسمت‌ها، گرافیک‌ها و توضیحات پادکست مستقیماً توسط Igor Melnyk یا شریک پلتفرم پادکست آن‌ها آپلود و ارائه می‌شوند. اگر فکر می‌کنید شخصی بدون اجازه شما از اثر دارای حق نسخه‌برداری شما استفاده می‌کند، می‌توانید روندی که در اینجا شرح داده شده است را دنبال کنید.https://fa.player.fm/legal
مشابه Arxiv Papers
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Get in-depth coverage of current and future trends in technology, and how they are shaping business, entertainment, communications, science, politics, and society.
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
Artificial Intelligence has suddenly gone from the fringes of science to being everywhere. So how did we get here? And where's this all heading? In this new series of Science Friction, we're finding out.
…
continue reading
I discuss a variety of topics in both the natural and social sciences, exploring the many fascinating insights that the scientific method yields about the world around us.
…
continue reading
Help me fill in the blanks of the practice of ED Critical Care. In this podcast, we discuss all things related to the crashing, critically ill patient in the Emergency Department. Find the show notes at emcrit.org.
…
continue reading
The Skeptics' Guide to the Universe is a weekly science podcast discussing the latest science news, critical thinking, bad science, conspiracies and controversies. -The Skeptics' Guide to the Universe: Your escape to reality - Produced by SGU Productions, LLC: https://www.theskepticsguide.org
…
continue reading
The Science Show gives Australians unique insights into the latest scientific research and debate, from the physics of cricket to prime ministerial biorhythms.
…
continue reading
Trusted ER doctor Brian Goldman brings you honest and surprising stories that can change your health and your life. Expect deep conversations with patients, families and colleagues that show you what is and isn't working in Canadian healthcare. Guaranteed you’ll learn something new. Episodes drop every Friday.
…
continue reading
Player FM - برنامه پادکست
با برنامه Player FM !
با برنامه Player FM !
))
[QA] Retrieval Head Mechanistically Explains Long-Context Factuality
Manage episode 415008468 series 3524393
محتوای ارائه شده توسط Igor Melnyk. تمام محتوای پادکست شامل قسمت‌ها، گرافیک‌ها و توضیحات پادکست مستقیماً توسط Igor Melnyk یا شریک پلتفرم پادکست آن‌ها آپلود و ارائه می‌شوند. اگر فکر می‌کنید شخصی بدون اجازه شما از اثر دارای حق نسخه‌برداری شما استفاده می‌کند، می‌توانید روندی که در اینجا شرح داده شده است را دنبال کنید.https://fa.player.fm/legal
This paper investigates how transformer-based language models retrieve information from long contexts, identifying special attention heads called retrieval heads as crucial for this task.
https://arxiv.org/abs//2404.15574
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1021 قسمت
اشتراک گذاری
Manage episode 415008468 series 3524393
محتوای ارائه شده توسط Igor Melnyk. تمام محتوای پادکست شامل قسمت‌ها، گرافیک‌ها و توضیحات پادکست مستقیماً توسط Igor Melnyk یا شریک پلتفرم پادکست آن‌ها آپلود و ارائه می‌شوند. اگر فکر می‌کنید شخصی بدون اجازه شما از اثر دارای حق نسخه‌برداری شما استفاده می‌کند، می‌توانید روندی که در اینجا شرح داده شده است را دنبال کنید.https://fa.player.fm/legal
This paper investigates how transformer-based language models retrieve information from long contexts, identifying special attention heads called retrieval heads as crucial for this task.
https://arxiv.org/abs//2404.15574
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1021 قسمت
Όλα τα επεισόδια
×
به Player FM خوش آمدید!
Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.
مشابه Arxiv Papers
Come dive into one of the curiously delightful conversations overheard at National Geographic’s headquarters, as we follow explorers, photographers, and scientists to the edges of our big, weird, beautiful world. Hosted by Peter Gwin and Amy Briggs.
…
continue reading
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Get in-depth coverage of current and future trends in technology, and how they are shaping business, entertainment, communications, science, politics, and society.
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
Artificial Intelligence has suddenly gone from the fringes of science to being everywhere. So how did we get here? And where's this all heading? In this new series of Science Friction, we're finding out.
…
continue reading
I discuss a variety of topics in both the natural and social sciences, exploring the many fascinating insights that the scientific method yields about the world around us.
…
continue reading
Help me fill in the blanks of the practice of ED Critical Care. In this podcast, we discuss all things related to the crashing, critically ill patient in the Emergency Department. Find the show notes at emcrit.org.
…
continue reading
The Skeptics' Guide to the Universe is a weekly science podcast discussing the latest science news, critical thinking, bad science, conspiracies and controversies. -The Skeptics' Guide to the Universe: Your escape to reality - Produced by SGU Productions, LLC: https://www.theskepticsguide.org
…
continue reading
The Science Show gives Australians unique insights into the latest scientific research and debate, from the physics of cricket to prime ministerial biorhythms.
…
continue reading
Trusted ER doctor Brian Goldman brings you honest and surprising stories that can change your health and your life. Expect deep conversations with patients, families and colleagues that show you what is and isn't working in Canadian healthcare. Guaranteed you’ll learn something new. Episodes drop every Friday.
…
continue reading
Player FM - برنامه پادکست
با برنامه Player FM !
با برنامه Player FM !
