Jiri, Josh, et al,

On 6/11/08, Jiri Jelinek <[EMAIL PROTECTED]> wrote:
>
> On Wed, Jun 11, 2008 at 4:24 PM, J Storrs Hall, PhD <[EMAIL PROTECTED]>
> wrote:
> >If you can modify your mind, what is the shortest path to satisfying all
> your
> goals? Yep, you got it: delete the goals.
>
> We can set whatever goals/rules we want for AGI, including rules for
> [particular [types of]] goal/rule [self-]modifications.


... and here we have the makings of AGI run amok. With politicians and
religious leaders setting shitforbrains goals, an AGI will only become a big
part of an even bigger problem. For example, just what ARE our reasonable
goals in Iraq? Insisting on democratic rule is a prescription for disaster,
yet that appears to be one of our present goals, with all-too-predictable
results. We achieved our goal, but we certainly aren't at all happy with the
result.

My point with reverse reductio ad absurdum reasoning is that it is usually
possible to make EVERYONE happy with the results, but only with a process
that roots out the commonly held invalid assumptions. Like Gort (the very
first movie AGI?) in *The Day The Earth Stood Still*, the goal is peace, but
NOT through any particular set of detailed goals. In Iraq there was
near-peace under Saddam Hussein, but we didn't like his methods. I suspect
that reasonable improvements to his methods would have produced far better
results than the U.S. military can ever hope to produce there, given
anything like its present goals.

Steve Richfield



-------------------------------------------
agi
Archives: http://www.listbox.com/member/archive/303/=now
RSS Feed: http://www.listbox.com/member/archive/rss/303/
Modify Your Subscription: 
http://www.listbox.com/member/?member_id=8660244&id_secret=103754539-40ed26
Powered by Listbox: http://www.listbox.com

Reply via email to