PM, Telmo Menezes <[email protected]> wrote: > What is our disagreement here exactly? You just seem to dislike my lack > of reverence for Watson. >
I have no problem when people point out that Watson can't perform task X, but it makes me nuts when they say Watson accomplished task X much better than I did but it doesn't *really* count as intelligence because it used method Y rather than method Z that I did, a method that didn't work. > > We might not fully understand the consequences of what we are asking the > machine to do, but the machine will never do anything except trying to > optimize the reward we defined. When it gets smart enough I see no reason why the machine could't redefine the entire reward function so that it was more to it's liking, even if it wasn't what humans would prefer. > > People always assume that it would chose to exterminate us, > I don't think it's inevitable that Mr.Jupiter Brain would want to exterminate us, maybe he would and maybe he wouldn't, but it's only a matter of time before He stops taking orders from us. John K Clark -- You received this message because you are subscribed to the Google Groups "Everything List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/everything-list. For more options, visit https://groups.google.com/d/optout.
