Scientists Discuss the AI Alignment Problem

Thanks to our friends at Future of Life Institute for supporting today’s episode. To learn more about FOL and this year's winners, make sure to visit https://futureoflife.org/ How can we ensure technology evolves ethically in a rapidly advancing world? Neil deGrasse Tyson and co-hosts Chuck Nice & Gary O’Reilly dive into the challenges of designing a future where human values and cutting-edge AI coexist, with The Future of Life Award’s 2024 recipients Batya Friedman and Steve Omohundro. Batya introduces us to the concept of value-sensitive design and how we can integrate ethics and human values into technological development. We explore unintended consequences and an inventor’s responsibility when they put their work out into the world. Learn how her work has reshaped court systems in Washington State and why human connection remains vital in an increasingly automated world. Steve explores the promises and perils of artificial intelligence. As AI moves closer to making decisions that impact humanity, how do we regulate and incentivize safety? Steve highlights the risks of open-source AI, the hardware arms race, and quantum computing’s potential to amplify existing challenges. Can we develop ethical guardrails to prevent AI from becoming a threat? And what role will superhuman AI mathematicians play in designing secure systems? Timestamps: 00:00 - Introduction: Ethics of Technology 1:33 - Batya Friedman: Value Sensitive Design 4:38 - Considering Unintended Consequences 13:46 - Evolving Ethics 21:25 - Steve Omohundro: Establishing AI Ethics 26:10 - Embracing Safety Architecture 29:42 - Quantum Computing & Curtailing Bad Actors 37:07 - Breaking it Down: Evolving AI With Safety Check out our second channel, @StarTalkPlus Get the NEW StarTalk book, 'To Infinity and Beyond: A Journey of Cosmic Discovery' on Amazon: https://amzn.to/3PL0NFn Support us on Patreon: https://www.patreon.com/startalkradio FOLLOW or SUBSCRIBE to StarTalk: Twitter: http://twitter.com/startalkradio Facebook: https://www.facebook.com/StarTalk Instagram: https://www.instagram.com/startalk About StarTalk: Science meets pop culture on StarTalk! Astrophysicist & Hayden Planetarium director Neil deGrasse Tyson, his comic co-hosts, guest celebrities & scientists discuss astronomy, physics, and everything else about life in the universe. Keep Looking Up! #StarTalk #NeildeGrasseTyson