[agi] Re: Asimov-like reaction ?
Hi David What of the possibility, Ben, of an Asimov-like reaction to the possibility of thinking machines that compete with humans? It's the kind of dumb, Man-Was-Not-Meant-to-Go-There, scenario we see all the time on Sci-Fi Channel productions, but it is plausible, especially in a world where so many people still haven't accepted that technology has improved lives, ignoring the evidence of much of their own environment. If the next big thing (advanced AGI) were to treat us like we treat the species we've advanced over, then I'd say humans have good reason to be nervous. But I think the solution is for humans and AGIs to grow up together and for AGIs to have to develop with well developed ethical capabilities/standards. Is anybody working on building ethical capacity into AGI from the ground up? As I mentioned to Ben yesterday, AGIs without ethics could end up being the next decade's e-viruses (on steriods). Cheers, Philip --- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/
RE: [agi] Re: Asimov-like reaction ?
Is anybody working on building ethical capacity into AGI from the ground up? As I mentioned to Ben yesterday, AGIs without ethics could end up being the next decade's e-viruses (on steriods). Cheers, Philip My thoughts on this are at www.goertzel.org/dynapsyc/2002/AIMorality.htm Michael has already pointed you to Eliezer Yudkowsky's site, which contains his own, related but different, perspective. -- ben --- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/
[agi] RE: Ethical drift
Ben Goertzel wrote: What if iterative self-revision causes the system's goal G to drift over time... I think this is inevitable - it's just evolution keeping on going as it always will. The key issue then is what processes can be set in train to operate throughout time to keep evolution re-inventing/re-committing AGIs (and humans too) to ethical behaviour. Maybe communities of AGIs can create this dynamic. Can isolated, non-socialised AGIs be ethical in relation to the whole? A book that I found facinating on the ethics issue in ealier evolutionaryu stages is: Good Natured: The Origins of Right and Wrong in Humans and Other Animals by Frans De Waal, Frans de Waal (Paperback - October 1997) Harvard Univ Pr; ISBN: 0674356616; Reprint edition (October 1997) It's well worth a read. Cheers, Philip Of course, one can seek to architect one's AGI system to mitigate against goal drift under iterative self-revisions. But algorithmic information theory comes up again, here. At some point, a self-revising AGI system, which adds new hardware onto itself periodically, will achieve a complexity (in the alg. info. theory sense) greater than that of the human brain. At this point, one can formally show, it is *impossible for humans to predict what it will do*. We just don't have the compute power in our measly little brains So we certainly can't be sure that goal drift won't occur in a system of superhuman complexity... This is an issue to be rethought again again as AGI gets closer closer... -- Ben --- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/ --- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/
RE: [agi] Commercial AGI ventures
One trouble with this endeavor is that AGI is a fuzzy set... However, I'd be quite interested to see this list, even so. In fact, I think it'd be more valuable to simply see a generic list of all AGI projects, be they commercial or non. If anyone wants to create such a list, I'll be happy to post it on the revised www.realai.net site, due in a month or so. -- Ben -Original Message- From: [EMAIL PROTECTED] [mailto:owner-agi;v2.listbox.com]On Behalf Of Simon McClenahan Sent: Monday, November 04, 2002 6:47 PM To: [EMAIL PROTECTED] Subject: [agi] Commercial AGI ventures Is there a list of (potential) AGI vendors somewhere? Other than Novamente and A2I2, has someone compiled a list of commercial institutions that are pushing their wares towards AGI? cheers, Simon --- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/
