3
Shared Docs
3
Same-Page
6 / 3
Mentions
at a superintelligence will necessarily share any of the final values stereotypically associated with wisdom and intellectual development in humans,” Bostrom wrote. “It is no less possible—and probably technically easier—to build a superintelligence that places final value on nothing but calculating.” And
it has punched the entire world into paperclips. You had to hope someone had remembered to place a “halt” command into is logic somewhere. And though Bostrom’s messianic wire twister is unlikely - of course, no one is going to forget to tell a machine to stop making paperclips - the power of his example is
reakthrough. So after developing his algorithms, he wanted to find an intuitive demonstration. He decided to build a 175 In 1965: Joseph Weizenbaum, Computer Power and Human Reason, W.H. Freeman and Company, 1976 p. 7 120 HOUSE_OVERSIGHT_018352 system that could, in a very limited sense, converse. The computer would take type
calling nuclear engineers “anti-physics.” The purpose of understanding and preventing the risks of AI is to ensure that we can realize the benefits. Bostrom, for example, writes that success in controlling AI will result in “a civilizational trajectory that leads to a compassionate and jubilant use of hum
l of checkmate; the same chessboard and pieces can be used for suicide chess, or indeed many other games still to be invented. Put another way: Where Bostrom imagines humans driven extinct by a putative robot that turns the planet into a sea of paper clips, we humans see this outcome as tragic, 4 Elon Mus
ons” (as Kant put it) presented to them. It is important that we keep it that way, which will take some doing. One of the flaws in Weizenbaum’s book Computer Power and Human Reason, something I tried in vain to convince him of in many hours of discussion, is that he could never decide which of two theses he wanted to defend: AJ
calling nuclear engineers “anti-physics.” The purpose of understanding and preventing the risks of AI is to ensure that we can realize the benefits. Bostrom, for example, writes that success in controlling AI will result in “a civilizational trajectory that leads to a compassionate and jubilant use of hum
l of checkmate; the same chessboard and pieces can be used for suicide chess, or indeed many other games still to be invented. Put another way: Where Bostrom imagines humans driven extinct by a putative robot that turns the planet into a sea of paper clips, we humans see this outcome as tragic, 4 Elon Mus
ons” (as Kant put it) presented to them. It is important that we keep it that way, which will take some doing. One of the flaws in Weizenbaum’s book Computer Power and Human Reason, something I tried in vain to convince him of in many hours of discussion, is that he could never decide which of two theses he wanted to defend: AJ
Entities connected to both Bostrom and Computer Power and Human Reason

Prince Andrew
PERSON
Elon Musk
PERSON
Jaan Tallinn
PERSON
Frank Wilczek
PERSON
Stuart Russell
PERSON
Alan Dershowitz
PERSON
Stephen Hawking
PERSON
George W. Bush
PERSON
Marc Rich
PERSONLeon Black
PERSON
Julie K. Brown
PERSONDoug Band
PERSON
Harvey Weinstein
PERSON
Samantha Power
PERSON
Earth
LOCATION
Robert Gates
PERSON
Bill Gates
PERSON
Turing
PERSON
Martha Stewart
PERSON
Feynman
PERSON