The AI system could be built as more of an advisor of actions that we might
take.
The investment field has already progressed into automated program trading.
I would bet that the investment brokers have some human monitors watching
and maybe even approving the trading.
But you have heard the story many times...
Nothing can go wrong... go wrong... go wrong....
Dan Goe
----- Original Message -----
From: "BillK" <[EMAIL PROTECTED]>
To: <agi@v2.listbox.com>
Cc: <[EMAIL PROTECTED]>
Sent: Wednesday, June 07, 2006 4:08 AM
Subject: Re: [agi] Two draft papers: AI and existential risk; heuristics and
biases
On 6/7/06, Eliezer S. Yudkowsky wrote:
<snip>
Because this is a young field, how much mileage you get out will be
determined in large part by how much sweat you put in. That's the
simple practical truth. The reasons why you do X are irrelevant given
that you do X; they're "screened off", in Pearl's terminology. It
doesn't matter how good your excuse is for putting off work on Friendly
AI, or for not building emergency shutdown features, given that that's
what you actually do. And this is the complaint of IT security
professionals the world over; that people would rather not think about
IT security, that they would rather do the minimum possible and just get
it over with and go back to their day jobs. Who can blame them for such
human frailty? But the result is poor IT security.
This is the real world that you have to deal with.
You cannot get the funding, or the time, to do the job properly,
because there is always pressure to be the first to market.
AGI is so tricky a problem that just getting it to work at all is
regarded as a minor miracle. (Like the early days of computers and
the internet).
Implement first, we can always patch it afterwards.
A much more worrying consideration, of course, is that the people with
the most resources, DARPA (and the Chinese) want an AGI to help them
kill their enemies. For defensive reasons only, naturally.
When AGI is being developed as a weapon by massive government
resources, AGI ethics and being Friendly doesn't even get into the
specification.
Following orders from the human owners does.
BillK
-------
To unsubscribe, change your address, or temporarily deactivate your
subscription, please go to
http://v2.listbox.com/member/[EMAIL PROTECTED]
--
No virus found in this incoming message.
Checked by AVG Free Edition.
Version: 7.1.394 / Virus Database: 268.8.2/357 - Release Date: 6/6/2006
-------
To unsubscribe, change your address, or temporarily deactivate your subscription,
please go to http://v2.listbox.com/member/[EMAIL PROTECTED]
