Keith Elis wrote:
Shane Legg wrote:
--------------------
If a machine was more intelligent/complex/conscious/...etc... than
all of humanity combined, would killing it be worse than killing all of
humanity?
--------------------
You're asking a rhetorical question but let's just get the correct
answer out there first: If it comes down to killing me or a machine, I
want that machine dead. If you're going to navel-gaze over some
hair-splitting ethical conundrum concerning who it makes more objective
sense to terminate, I'll kill it myself while you're pondering. And
since you're not sure whether killing machines is worse or better than
killing me and the people I care about, I'm probably going to have to do
something about you, too, since you're the guy trying to build the damn
things.
On what basis is that answer correct? Do you mean factual in that it is
the choice that you would make and that you belief proper? Or are you
saying it is more objectively correct. If so, on what basis? Mere
assertion and braggadocio will not do for an objective response.
The question is not one of which to kill but of which, if either, it is
morally worse to kill and why.
If in general humans can be expected to prefer themselves and their
continuance much more than even the most unimaginably powerful and
wonderful non-human intelligence or species and if it is generally
certain they would consider a more powerful intelligence a very real
threat then they become a problem to such an intelligence it would
seem. Unless of course they are so hopelessly outclassed that the
intelligence can let the stew to their heart's content.
I have been of a mind for years to start a public website about 'Scary
AI Researchers' where people can look up the scariest things said by the
various AI researchers and learn more about them. I haven't done this
because I don't want to put anyone at risk.
So instead you put out an implied threat that might tend to suppress
open exploration of such questions? Would you prefer conclusions to be
reached privately in this area?
- samantha
-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=4007604&user_secret=7d7fb4d8
