On 11/27/2017 2:09 PM, Jason Resch wrote:
I think there might be two ways of interpreting this, each with different answers.

The first question: Does AI create more threats that never existed before?

I think the answer is most definitely yes. Some examples:
- Large scale unemployment/disempowerment of people who cannot compete with increasing machine intelligence
- Algorithms that identify and wipe out dissent / control opposition
- New and terrifying weapons (e.g. https://www.youtube.com/watch?v=HipTO_7mUOw ) - More infrastructure and systems that can be hacked or introduce defects (air traffic control systems, self-driving cars, etc.)

The second question: Will super intelligence ultimately decide to eliminate us (as meaningless, redundant, to make room for more computation, etc.)?

This question is more interesting. I tend to fall in the camp that we exercise little control over the ultimate decision made by such a super intelligence, but I am optimistic that a super intelligence will, during the course of its ascension, discover and formalize a system of ethics, and this may lead to it deciding not to wipe out other life forms.  For example, it might discover the same ideas expressed here ( https://www.researchgate.net/profile/Arnold_Zuboff/publication/233329805_One_Self_The_Logic_of_Experience/links/54adcdb60cf2213c5fe419ec/One-Self-The-Logic-of-Experience.pdf ) and therefore determine something like the golden rule is rationally justified.

Marvin Minsky said, "I'm on the side of greater intelligence."

Brent

--
You received this message because you are subscribed to the Google Groups 
"Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/everything-list.
For more options, visit https://groups.google.com/d/optout.

Reply via email to