> If you take the morality out of intelligence then you should use the term > "power." But that's exactly what intelligence is: a form of power, specifically concerned with the skills of thinking, planning, strategizing, etc. Just look at a standard IQ (Intelligence Quotient) test: nothing about it measures how virtuous you are. It's solely concerned with thinking skills. Intelligence is the mental capacity for problem solving; if you apply high intelligence to solve "problems" like "I wish this person were gone because I hate him," then you're an evil genius.
Intelligence does enable moral reasoning, and maybe that is what's leading to the confusion here. But it's entirely possible to *know *the right thing to do and still choose not to do it. It's also possible to start with such faulty moral axioms that no amount of deduction will lead you in the right direction. > If we change the meaning of intelligence, so that it no longer has the > element of goodness, then we are wrong to embrace it and idolize it. I don't think intelligence ever had much to do with goodness. You're the one who's trying to change its meaning to something non-standard. "Wisdom" or "enlightenment" can incorporate goodness, at least in some contexts. As for whether embracing intelligence is wrong: like any form of power, it's a tool. Good people do their best to use tools for good, so getting more tools (including intelligence) into the hands of good people is a worthy enough goal. I agree that if we don't have the *combination* of morality and intelligence, then intelligence is worthless. This may seem like a pointless semantic quibble, but I think there are real concerns here that are worth drawing out. Some people get the idea that if you just make an AGI smart enough, you'll get the morality part for free. I highly doubt that this is the case! I recommend looking up the "orthogonality thesis" and doing some reading thereon. Morality, altruism, "human values," etc. are distinct from intellectual capacity, and must be *intentionally *incorporated into AGI if you want a complete, healthy artificial personality. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Tc67faac3048278cf-M2a6c8c6a2a93e3e41775282c Delivery options: https://agi.topicbox.com/groups/agi/subscription
