On 11 Feb 2015, at 22:22, Stathis Papaioannou wrote:

On 12 February 2015 at 02:50, Jason Resch <[email protected]> wrote:

Sure, but the AI may still decide to do evil, perverse or self destructive things. There is no contradiction in superintelligence behaving this way.



It's an assumption to say there is no contradiction. If it's beliefs are defined to be almost completely correct, why would its actions not follow its beliefs and also be almost completely correct? Unless we are talking about a superintelligence with some kind of malfunction, I would think its actions would be driven by its beliefs. Do you think morality is relative or
universal?

Morality is a value, and values have no ultimate logical or empirical
justification.

I agree.
But I would still side with Jason, as I find conceivable that morality has an arithmetical of computer-science justification. It might be somehow based on self-satisfaction + empathy for (less and less similar) entities, leading to reasonable self-satisfaction (= without lying to others, respecting truth, etc.).
Platonists usually bet on some relationships between truth and good.

I am not as sure as Plato, on this. It annoys me, but even in arithmetic, lies can be fruitful, a bit like in nature spider can lie to birds to just survive (making them believe they are non edible ants, for example).

Open problem, to say the least.

Bruno








--
Stathis Papaioannou

--
You received this message because you are subscribed to the Google Groups "Everything List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/everything-list.
For more options, visit https://groups.google.com/d/optout.

http://iridia.ulb.ac.be/~marchal/



--
You received this message because you are subscribed to the Google Groups 
"Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/everything-list.
For more options, visit https://groups.google.com/d/optout.

Reply via email to