Michael Anissimov wrote:
>
> Philip Sutton wrote:
> >Maybe we need to think about an 'ethics system' that is woven into the
> >whole Novamente architecture and processes.
>
> How about a benevolence-capped goal system where all the AI's actions
> flow from a single supergoal? That way you aren't adding ethics into a
> fundamentally ethics-indifferent being, but creating a system that is
> ethical from the foundations upward.
This is a key aspect of Eliezer Yudkowsky's "Friendly Goal Architecture"
The Novamente design does not lend itself naturally to a hierarchical goal
structure in which "all the AI's actions flow from a single supergoal."
GoalNodes are simply PredicateNodes that are specially labeled as GoalNodes;
the special labeling indicates to other MindAgents that they are used to
drive schema (procedure) learning.
[Please note: there are no GoalNodes in the codebase yet, we are still
engineering and testing simpler stuff; I am speaking about the design not
the current codebase. We had them in Webmind's codebase, but that was a
somewhat different system.]
Novamente's GoalNode refinement algorithms, even if you START THEM OFF with
a single GoalNode like "promote the survival and happiness of humans and
other intelligent and living creatures" [just a hastily-worded example -- I
am not proposing this as a single initial goal], will naturally and
intrinsically produce a complex hierarchical/heterarchical web of goals,
some potentially conflicting with each other.
> Letting the AI grow up with
> whichever goals look immediately useful, ("regularly check and optimize
> chunk of code X", "win this training game", etc.) and then trying
> to "weave in ethics" ...
That was not my suggestion at all, though. The ethical goals can be there
from the beginning. It's just that a purely hierarchical goal structure is
highly unlikely to emerge as a "goal map", i.e. an attractor, of Novamente's
self-organizing goal-creating dynamics.
Ben G
-------
To unsubscribe, change your address, or temporarily deactivate your subscription,
please go to http://v2.listbox.com/member/?[EMAIL PROTECTED]
