--- Eugen Leitl <[EMAIL PROTECTED]> wrote: > On Tue, Jun 05, 2007 at 01:24:04PM -0700, Tom McCabe > wrote: > > > Unless, of course, that human turns out to be evil > and > > That why you need to screen them, and build a group > with > checks and balances.
If our psychology is so advanced that we're willing to trust the fate of the world with it, why have we had no success at getting prisoners to avoid committing further crimes, even when we have them under 24/7 control and observation for years on end? Keep in mind that Hitler, Stalin, and the like, at age 20, would have seemed like normal, regular guys. > > proceeds to use his power to create The Holocaust > Part > > II. Seriously- out of all the people in positions > of > > power, a very large number are nasty jerks who > abuse > > That's a bit simplistic. Obviously there is some selection effect (people who are nasty jerks tend to want power more than others), but it's not so severe that an insignificant part of the population falls under the category of "potential evil overlord". > > that power. I can't think of a single great world > > power that has not committed atrocities. Why > should we > > be willing to trust in a human whose motivations > are > > geared primarily towards producing the largest > number > > of surviving grandchildren on the African savanna? > If > > As opposed to what, exactly? A computer system that we can design to spec, test to an arbitrary degree of precision in a sandbox computer environment, and for which the mathematics of behavior are tractable. > > I designed an AI that way, and proposed to give it > > superintelligence, everyone would (correctly) > denounce > > me as an insane crackpot. > > If you set out to design a human-equivalent AI, > you're > considered a crackpot on principle, so you can > relax. I meant among people who actually think of human-equivalent AI as viable. > -- > Eugen* Leitl <a href="http://leitl.org";>leitl</a> > http://leitl.org > ______________________________________________________________ > ICBM: 48.07100, 11.36820 http://www.ativel.com > http://postbiota.org > 8B29F6BE: 099D 78BA 2FD3 B014 B08A 7779 75B0 2443 > 8B29 F6BE > > ----- > This list is sponsored by AGIRI: > http://www.agiri.org/email > To unsubscribe or change your options, please go to: > http://v2.listbox.com/member/?&; > ____________________________________________________________________________________ Never miss an email again! Yahoo! Toolbar alerts you the instant new Mail arrives. http://tools.search.yahoo.com/toolbar/features/mail/ ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=4007604&user_secret=7d7fb4d8
