Amazon cover image
Image from Amazon.com

If anyone builds it, everyone dies : why superhuman AI would kill us all / Eliezer Yudkowsky, Nate Soares.

By: Contributor(s): Publisher: New York : Little, Brown and Company, 2025Edition: First editionDescription: 259 pages cmContent type:
  • text
Media type:
  • unmediated
Carrier type:
  • volume
ISBN:
  • 9780316595643
Genre/Form: LOC classification:
  • Q335 .Y83 2025
Summary: "An urgent warning from two artificial intelligence insiders on the reckless scramble to build superhuman AI-and how it will end humanity unless we change course. In 2023, hundreds of machine-learning scientists signed an open letter warning about our risk of extinction from smarter-than-human AI. Yet today, the race to develop superhuman AI is only accelerating, as many tech CEOs throw caution to the wind, aggressively scaling up systems they don't understand-and won't be able to restrain. There is a good chance that they will succeed in building an artificial superintelligence on a timescale of years or decades. And no one is prepared for what will happen next. For over 20 years, two signatories of that letter-Eliezer Yudkowsky and Nate Soares-have been studying the potential of AI and warning about its consequences. As Yudkowsky and Soares argue, sufficiently intelligent AIs will develop persistent goals of their own: bleak goals that are only tangentially related to what the AI was trained for; lifeless goals that are at odds with our own survival. Worse yet, in the case of a near-inevitable conflict between humans and AI, superintelligences will be able to trivially crush us, as easily as modern algorithms crush the world's best humans at chess, without allowing the conflict to be close or even especially interesting. How could an AI kill every human alive, when it's just a disembodied intelligence trapped in a computer? Yudkowsky and Soares walk through both argument and vivid extinction scenarios and, in so doing, leave no doubt that humanity is not ready to face this challenge-ultimately showing that, on our current path, If Anyone Builds It, Everyone Dies"--
Item type: BOOKS
Star ratings
    Average rating: 0.0 (0 votes)
Holdings
Current library Home library Call number Status Barcode
Alfaisal University On Shelf Alfaisal University On Shelf Q335 .Y83 2025 (Browse shelf(Opens below)) Available AU00000000021122
Total holds: 0

"An urgent warning from two artificial intelligence insiders on the reckless scramble to build superhuman AI-and how it will end humanity unless we change course. In 2023, hundreds of machine-learning scientists signed an open letter warning about our risk of extinction from smarter-than-human AI. Yet today, the race to develop superhuman AI is only accelerating, as many tech CEOs throw caution to the wind, aggressively scaling up systems they don't understand-and won't be able to restrain. There is a good chance that they will succeed in building an artificial superintelligence on a timescale of years or decades. And no one is prepared for what will happen next. For over 20 years, two signatories of that letter-Eliezer Yudkowsky and Nate Soares-have been studying the potential of AI and warning about its consequences. As Yudkowsky and Soares argue, sufficiently intelligent AIs will develop persistent goals of their own: bleak goals that are only tangentially related to what the AI was trained for; lifeless goals that are at odds with our own survival. Worse yet, in the case of a near-inevitable conflict between humans and AI, superintelligences will be able to trivially crush us, as easily as modern algorithms crush the world's best humans at chess, without allowing the conflict to be close or even especially interesting. How could an AI kill every human alive, when it's just a disembodied intelligence trapped in a computer? Yudkowsky and Soares walk through both argument and vivid extinction scenarios and, in so doing, leave no doubt that humanity is not ready to face this challenge-ultimately showing that, on our current path, If Anyone Builds It, Everyone Dies"--

Copyright © 2020 Alfaisal University Library. All Rights Reserved.
Tel: +966 11 2158948 Fax: +966 11 2157910 Email:
librarian@alfaisal.edu