On 9/10/2019 3:58 PM, John Clark wrote:
On Tue, Sep 10, 2019 at 6:05 PM 'Brent Meeker'
<[email protected]
<mailto:[email protected]>> wrote:
/> Actually I think they would be careful NOT have it value its
survival. /
I think that would mean the AI would need to be in intense constant
pain for that to happen, or be deeply depressed like the robot Marvin
in Hitchhiker's Guide to the Galaxy. And I think it would be grossly
unethical to make such an AI.
Why would it mean that? Why wouldn't the AI agree with Bruno that it
was just computation and it existed in Platonia anyway so it was
indifferent to transient existence here?
/> They would want to be able to shut it off. /
You can't outsmart someone smarter than you, the humans are never
going to be able to shut it off unless the AI wants to be shut off.
Exactly why you might program it to want to be shut off in certain
circumstances.
Of course the problem with "We can always shut it off." is that once you
rely on it, you don't dare shut if off because it knows better than you
do and you know it knows better.
Brent
> The problem is that there's no way to be sure that survival isn't
implicit in any other values you give it.
Exactly.
> /A neuralnetwork has knowledge rather in the way human intuition
embodies knowledge. So it's useful in say predicting hurricanes.
But it doesn't provide us with a theory of predicting hurricanes;
it's more like an oracle./
There is a theory of thermodynamics but there probably isn't a theory
of hurricane movement, not one where we could say it did this rather
than that for the simple reason X; it won't be simple, X probably
contains a few thousand Exabytes of data.
John K Clark
--
You received this message because you are subscribed to the Google
Groups "Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to [email protected]
<mailto:[email protected]>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/everything-list/CAJPayv2CpZPd%2B2ByECGE9QizvrbKG6sTpbpmQpgLc9eMvArwyg%40mail.gmail.com
<https://groups.google.com/d/msgid/everything-list/CAJPayv2CpZPd%2B2ByECGE9QizvrbKG6sTpbpmQpgLc9eMvArwyg%40mail.gmail.com?utm_medium=email&utm_source=footer>.
--
You received this message because you are subscribed to the Google Groups
"Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/everything-list/288494a8-c5df-b85a-ff3a-53a3b0fc1141%40verizon.net.
