I think there might be two ways of interpreting this, each with different answers.
The first question: Does AI create more threats that never existed before? I think the answer is most definitely yes. Some examples: - Large scale unemployment/disempowerment of people who cannot compete with increasing machine intelligence - Algorithms that identify and wipe out dissent / control opposition - New and terrifying weapons (e.g. https://www.youtube.com/watch?v=HipTO_7mUOw ) - More infrastructure and systems that can be hacked or introduce defects (air traffic control systems, self-driving cars, etc.) The second question: Will super intelligence ultimately decide to eliminate us (as meaningless, redundant, to make room for more computation, etc.)? This question is more interesting. I tend to fall in the camp that we exercise little control over the ultimate decision made by such a super intelligence, but I am optimistic that a super intelligence will, during the course of its ascension, discover and formalize a system of ethics, and this may lead to it deciding not to wipe out other life forms. For example, it might discover the same ideas expressed here ( https://www.researchgate.net/profile/Arnold_Zuboff/publication/233329805_One_Self_The_Logic_of_Experience/links/54adcdb60cf2213c5fe419ec/One-Self-The-Logic-of-Experience.pdf ) and therefore determine something like the golden rule is rationally justified. Jason On Mon, Nov 27, 2017 at 3:32 PM, <[email protected]> wrote: > IIRC, this is the view of Hawking and Musk. > > -- > You received this message because you are subscribed to the Google Groups > "Everything List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/everything-list. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Everything List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/everything-list. For more options, visit https://groups.google.com/d/optout.
