3
Shared Docs
3
Same-Page
6 / 3
Mentions
at a superintelligence will necessarily share any of the final values stereotypically associated with wisdom and intellectual development in humans,” Bostrom wrote. “It is no less possible—and probably technically easier—to build a superintelligence that places final value on nothing but calculating.” And
it has punched the entire world into paperclips. You had to hope someone had remembered to place a “halt” command into is logic somewhere. And though Bostrom’s messianic wire twister is unlikely - of course, no one is going to forget to tell a machine to stop making paperclips - the power of his example is
creators were limiting what it had been asked to do. At which point the AI would turn to thinking about how to escape those bounds. It would be like Deep Blue programmed to plan its own prison break. And as much as humans might try to stifle a smart machine, we’d be fighting to contain something more powerf
calling nuclear engineers “anti-physics.” The purpose of understanding and preventing the risks of AI is to ensure that we can realize the benefits. Bostrom, for example, writes that success in controlling AI will result in “a civilizational trajectory that leads to a compassionate and jubilant use of hum
l of checkmate; the same chessboard and pieces can be used for suicide chess, or indeed many other games still to be invented. Put another way: Where Bostrom imagines humans driven extinct by a putative robot that turns the planet into a sea of paper clips, we humans see this outcome as tragic, 4 Elon Mus
e and evaluate a vast selection of possible future moves. But the majority of predictions of AI, e.g., robotic maids, turned out to be illusory. When Deep Blue beat Garry Kasparov at chess in 1997, the most 20 HOUSE_OVERSIGHT_016823 powerful room-cleaning robot was a Roomba, which moved around vacuuming a
calling nuclear engineers “anti-physics.” The purpose of understanding and preventing the risks of AI is to ensure that we can realize the benefits. Bostrom, for example, writes that success in controlling AI will result in “a civilizational trajectory that leads to a compassionate and jubilant use of hum
l of checkmate; the same chessboard and pieces can be used for suicide chess, or indeed many other games still to be invented. Put another way: Where Bostrom imagines humans driven extinct by a putative robot that turns the planet into a sea of paper clips, we humans see this outcome as tragic, 4 Elon Mus
e and evaluate a vast selection of possible future moves. But the majority of predictions of AI, e.g., robotic maids, turned out to be illusory. When Deep Blue beat Garry Kasparov at chess in 1997, the most 20 HOUSE_OVERSIGHT_016240 powerful room-cleaning robot was a Roomba, which moved around vacuuming a
Entities connected to both Bostrom and Deep Blue

Marc Rich
PERSON
Stephen Hawking
PERSONJeopardy
ORGANIZATION
Garry Kasparov
PERSON
Prince Andrew
PERSON
Elon Musk
PERSONDoug Band
PERSON
Alan Dershowitz
PERSON
Samantha Power
PERSON
Jeffrey Epstein
PERSONAlphaGo
PERSON
Turing
PERSONLeon Black
PERSON
Frank Wilczek
PERSON
Jaan Tallinn
PERSON
Feynman
PERSON
Joseph Weizenbaum
PERSON
Robert Gates
PERSON
Stuart Russell
PERSON
Earth
LOCATION