Bill Hibbard wrote:
On Mon, 10 Feb 2003, Ben Goertzel wrote:
A goal in Novamente is a kind of predicate, which is just a
function that
assigns a value in [0,1] to each input situation it observes...
i.e. it's a
'valuation' ;-)
Interesting. Are these values used for
Ben/Bill,
My feeling is that goals and ethics are not identical concepts. And I
would think that goals would only make an intentional ethical
contribution if they related to the empathetic consideration of others.
So whether ethics are built in from the start in the Novamente
architecture
Ben,
Right from the start, even before there is an intelligent autonomous mind
there, there will be goals that are of the basic structural character of
ethical goals. I.e. goals that involve the structure of compassion, of
adjusting the system's actions to account for the well-being of
On Wed, 12 Feb 2003, Philip Sutton wrote:
Ben/Bill,
My feeling is that goals and ethics are not identical concepts. And I
would think that goals would only make an intentional ethical
contribution if they related to the empathetic consideration of others.
. . .
Absolutely goals (I prefer
Bill Hibbard wrote:
On Wed, 12 Feb 2003, Philip Sutton wrote:
Ben/Bill,
My feeling is that goals and ethics are not identical concepts. And I
would think that goals would only make an intentional ethical
contribution if they related to the empathetic consideration of others.
Absolutely
Hi Philip,
On Tue, 11 Feb 2003, Philip Sutton wrote:
Ben,
If in the Novamente configuration the dedicated Ethics Unit is focussed
on GoalNode refinement, it might be worth using another term to
describe the whole ethical architecture/machinery which would involve
aspects of most/all (??)
My idea is that action-framing and environment-monitoring are carried
out in a unified way in Units assigned to these tasks generically.
..ethical thought gets to affect system behavior indirectly
through a), via ethically-motivated GoalNodes, both general ones and
Philip Sutton wrote:
Maybe we need to think about an 'ethics system' that is woven into the
whole Novamente architecture and processes.
How about a benevolence-capped goal system where all the AI's actions
flow from a single supergoal? That way you aren't adding ethics into a
fundamentally
Ben Goertzel wrote:
However, it's to be expected that an AGI's ethics will be different than any
human's ethics, even if closely related.
What do a Goertzelian AGI's ethics and a human's ethics have in common
that makes it a humanly ethical act to construct a Goertzelian AGI?
--
Eliezer S.
I think we all agree that, loosely speaking, we want our AGI's to have a
goal of respecting and promoting the survival and happiness of humans and
all intelligent and living beings.
However, no two minds interpret these general goals in the same way. You
and I don't interpret them exactly the
Ben Goertzel writes:
This is a key aspect of Eliezer Yudkowsky's Friendly Goal
Architecture
Yeah; too bad there isn't really anyone else to cite on this one. It
will be interesting to see what other AGI pursuers have to say about
the hierarchial goal system issue, once they write up their
Hi Ben,
I think discussing ethics in terms of goals leads to confusion.
As I described in an earlier post at:
http://www.mail-archive.com/agi@v2.listbox.com/msg00390.html
reasoning must be grounded in learning and goals must be grounded
in values (i.e., the values used to
There might even be a benefit to trying to develop an ethical system for
the earliest possible AGIs - and that is that it forces everyone to strip
the concept of an ethical system down to its absolute basics so that it
can be made part of a not very intelligent system. That will
]
Subject: RE: [agi] AGI morality
Ben,
One issue you didn't respond to that I suggested was:
I also think that AGIs need to have a built in commitment to devote an
adequate amount of mind space to monitoring the external environment
and internal thought processes to identify issues where
Ben,
I agree that a functionally-specialized Ethics Unit could make sense in
an advanced Novamente configuration. .devoting a Unit to ethics
goal-refinement on an architectural level would be a simple way of
ensuring resource allocation to ethics processing through successive
system
15 matches
Mail list logo
