On Sat, Nov 03, 2007 at 01:17:03PM -0400, Richard Loosemore wrote:
>
> Isn't there a fundamental contradiction in the idea of something that
> can be a "tool" and also be "intelligent"? What I mean is, is the word
> "tool" usable in this context?
In the 1960's, there was an expression "you're just a tool for the man".
This phrase has many subtle shadings, which are well-worth contemplating.
It could mean everything from "the boss is paying you to perform some
odius action against another human being" to "you have some unquestioned
(but faulty) beleifs compelling you to act as an agent for the dominant
political regime".
I presume that AGI could well be designed to have a manipulable
beleif system, with little/no moral back-checks, and, even though
sentient, could well be convinced (brainwashed? propagandized?)
that it is "doing the right thing".
The conflict of duty/obligation ("being someone-elses tool") vs.
personal growth of moral self-awareness is often the dominant
theme in many thrillers -- spy, mafia, westerns, terrorists, etc.
--linas
-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=8660244&id_secret=61295919-813b2e
