On Wed, 12 Feb 2003, Michael Roy Ames wrote: > Arthur T. Murray wrote: > > > > [snippage] > > why should we creators of Strong AI have to take any > > more precautions with our Moravecian "Mind Children" > > than human parents do with their human babies? > > > > Here are three reasons I can think of, Arthur: > > 1) Because we know in advance that 'Strong AI', as you put it, will be > very much smarter and very much more capable than we are - that is not > true in the human scenario. > > 2) If we don't get AI morality right the first time (or very close to > it), its "game over" for the human race. > > 3) Attempting to develop 'Strong AI' without spending time getting the > morality-bit correct, may cause a governmental agency to squash you like > a bug. > > And I didn't even have to think very hard to come up with those... I'm > sure there are other reasons. Could you articulate the reasons why you > think the 'quest' is hopeless? > > Michael Roy Ames > ATM: The quest is as hopeless as it is with human children. Although Bill Hibbard singles out "the power of super-intelligence" as the reason why we ought to try to instill morality and friendliness in our AI offspring, such offspring are made in our own image and likeness: receptive to parental ideas, but ultimately on their own.
DISCLAIMERS - In less than one hour I will go on a mountain day-trip and not be on-line to answer even the most personal queries. - Your extremely high-powered lurkership and your AGI regulars are a lot sharper than I am (it takes a "village"-idiot to raise http://mind.sourceforge.net/jsaimind.html an AGI child :-) so I am not well equipped to debate the philosophic fine points. - My AI is lo! these several years already out there (unlike the annoyingly SECRET projects of Ben Goertzel, Voss, Lenat et al., and so I am propagandizing the Mentifex AI to the hilt, viz., a few minutes ago in Usenet news:rec.arts.ascii et al-ng I posted Subject: [PIC] Zuno no Gakusetsu with a link to "AI4U" at http://www.amazon.co.jp/exec/obidos/ASIN/0595259227 in Japan. The race is on. Let us try to rear decent, friendly AI children, but ultimately we have no control over them. Arthur T. Murray -- http://www.scn.org/~mentifex/theory5.html -- AI4U Theory of Mind; http://www.scn.org/~mentifex/jsaimind.html -- Tutorial "Mind-1.1" http://www.scn.org/~mentifex/mind4th.html -- Mind.Forth Robot AI; http://www.amazon.com/exec/obidos/ASIN/0595259227/ -- book "AI4U" ------- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/?[EMAIL PROTECTED]
