On 10/2/07, Mark Waser wrote:
> A quick question for Richard and others -- Should adults be allowed to
> drink, do drugs, wirehead themselves to death?
>


This is part of what I was pointing at in an earlier post.

Richard's proposal was that humans would be asked in advance by the
AGI what level of protection they required.

So presumably Richard is thinking along the lines of a non-interfering
AGI, unless specifically requested.

There are obvious problems here.

Humans don't know what is 'best' for them.
Humans frequently ask for what they want, only later to discover that
they really didn't want that.  Humans change their mind all the time.
Humans don't know 'in advance' what level of protection they would
like. Death and/or mutilation comes very quickly at times.

If I was intending to be evil, say, commit mass murder, I would
request a lot of protection from the AGI, as other humans would be
trying to stop me.

------------------

I think the AGI will have great problems interfacing with these
mixed-up argumentative humans.  The AGI will probably have to do a lot
of 'brain correction' to straighten out humanity.
Let's hope that it knows what it is doing.

BillK

-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=8660244&id_secret=48932774-c6db65

Reply via email to