On Nov 3, 2007 12:58 PM, Mike Dougherty <[EMAIL PROTECTED]> wrote:
> You are describing a very convoluted process of drug addiction.

The difference is that I have safety controls built into that scenario.

> If I can get you hooked on heroine or crack cocaine, I'm pretty confident
> that you will abandon your desire to produce AGI in order to get more
> of the drugs to which you are addicted.

Right. We are wired that way. Poor design.

> You mentioned in an earlier post that you expect to have this
> monstrous machine invade my world and 'offer' me these incredible
> benefits.  It sounds to me like you are taking the blue pill and
> living contentedly in the Matrix.

If the AGI that controls the Matrix sticks with the goal system
initially provided by the blue pill party then why would we want to
sacrifice the non-stop pleasure? Imagine you would get periodically
unplugged to double check if all goes well outside - over and over
again finding (after very-hard-to-do detailed investigation) that
things go much better than how would they likely go if humans were in
charge. I bet your unplug attitude would relatively soon change to
something like "sh*t, not again!".

> If you are going to proselytize
> that view, I suggest better marketing.  The intellectual requirements
> to accept AGI-driven nirvana imply the rational thinking which
> precludes accepting it.

I'm primarily a developer, leaving most of the marketing stuff to
others ;-). What I'm trying to do here is to take a bit closer look at
the human goal system and investigate where it's likely to lead us. My
impression is that most of us have only very shallow understanding of
what we really want. When messing with AGI, we better know what we
really want.

Regards,
Jiri Jelinek

-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=8660244&id_secret=60767090-3c4431

Reply via email to