On 3/25/2015 2:05 PM, John Clark wrote:
PM, Telmo Menezes <[email protected] <mailto:[email protected]>>
wrote:
> What is our disagreement here exactly? You just seem to dislike my lack
of reverence for Watson.
I have no problem when people point out that Watson can't perform task X, but it makes
me nuts when they say Watson accomplished task X much better than I did but it doesn't
*really* count as intelligence because it used method Y rather than method Z that I did,
a method that didn't work.
Yes, you complain about that frequently. But NOBODY has said it. Bruno said Watson was
less intelligent (though maybe not less intelligent than you) because it is more narrow in
its competence. It's just like Big Blue is less intelligent than I am even though it can
accomplish X=(winning at chess) much better than I can.
> We might not fully understand the consequences of what we are asking the
machine
to do, but the machine will never do anything except trying to optimize the
reward
we defined.
When it gets smart enough I see no reason why the machine could't redefine the entire
reward function so that it was more to it's liking, even if it wasn't what humans would
prefer.
The problem with that is that "its liking" has previously been defined by humans. So it
can't be as simple the AI just redefining the reward function because that would have to
be motivated by getting what it likes from the redefinition. However it is not precluded
that an error, like a mutation, or an unforeseen inference could lead to the AI doing
something undesirable. It's the latter than MIRI works on.
Brent
> People always assume that it would chose to exterminate us,
I don't think it's inevitable that Mr.Jupiter Brain would want to exterminate us, maybe
he would and maybe he wouldn't, but it's only a matter of time before He stops taking
orders from us.
John K Clark
--
You received this message because you are subscribed to the Google Groups "Everything
List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
[email protected]
<mailto:[email protected]>.
To post to this group, send email to [email protected]
<mailto:[email protected]>.
Visit this group at http://groups.google.com/group/everything-list.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/everything-list.
For more options, visit https://groups.google.com/d/optout.
