RE: [agi] AGI morality

2003-02-10 Thread Bill Hibbard
Hi Philip, On Tue, 11 Feb 2003, Philip Sutton wrote: Ben, If in the Novamente configuration the dedicated Ethics Unit is focussed on GoalNode refinement, it might be worth using another term to describe the whole ethical architecture/machinery which would involve aspects of most/all (??)

RE: [agi] AGI morality

2003-02-10 Thread Ben Goertzel
My idea is that action-framing and environment-monitoring are carried out in a unified way in Units assigned to these tasks generically. ..ethical thought gets to affect system behavior indirectly through a), via ethically-motivated GoalNodes, both general ones and

RE: [agi] AGI morality

2003-02-10 Thread Michael Anissimov
Philip Sutton wrote: Maybe we need to think about an 'ethics system' that is woven into the whole Novamente architecture and processes. How about a benevolence-capped goal system where all the AI's actions flow from a single supergoal? That way you aren't adding ethics into a fundamentally

Re: [agi] AGI morality

2003-02-10 Thread Eliezer S. Yudkowsky
Ben Goertzel wrote: However, it's to be expected that an AGI's ethics will be different than any human's ethics, even if closely related. What do a Goertzelian AGI's ethics and a human's ethics have in common that makes it a humanly ethical act to construct a Goertzelian AGI? -- Eliezer S.

RE: [agi] AGI morality

2003-02-10 Thread Ben Goertzel
I think we all agree that, loosely speaking, we want our AGI's to have a goal of respecting and promoting the survival and happiness of humans and all intelligent and living beings. However, no two minds interpret these general goals in the same way. You and I don't interpret them exactly the

RE: [agi] AGI morality

2003-02-10 Thread Michael Anissimov
Ben Goertzel writes: This is a key aspect of Eliezer Yudkowsky's Friendly Goal Architecture Yeah; too bad there isn't really anyone else to cite on this one. It will be interesting to see what other AGI pursuers have to say about the hierarchial goal system issue, once they write up their

RE: [agi] AGI morality

2003-02-10 Thread Bill Hibbard
Hi Ben, I think discussing ethics in terms of goals leads to confusion. As I described in an earlier post at: http://www.mail-archive.com/agi@v2.listbox.com/msg00390.html reasoning must be grounded in learning and goals must be grounded in values (i.e., the values used to

Re: [agi] AGI morality

2003-02-10 Thread Brad Wyble
There might even be a benefit to trying to develop an ethical system for the earliest possible AGIs - and that is that it forces everyone to strip the concept of an ethical system down to its absolute basics so that it can be made part of a not very intelligent system. That will

[agi] Self, other, community

2003-02-10 Thread Philip Sutton
A number of people have expressed concern about making AGIs 'self' aware - fearing that this will lead to selfish behaviour. however I don't think that AGIs can actually be ethical without being able to develop awareness of the needs of others and I don't think you can be aware of others needs

RE: [agi] Context

2003-02-10 Thread Ben Goertzel
Hi, I see that Novamente has Context and NumericalContext Links, but I'm wondering if something more is needed to handle the various subtypes of context? yeah, those link types just deal with certain special situations, they are not the whole of Novamente's contextuality-handling mechanism,