Matt,

> But no matter. Whichever definition you accept, RSI is not a viable path to
> AGI. An AI that is twice as smart as a human can make no more progress than
> 2 humans. You don't have automatic self improvement until you have AI that
> is billions of times smarter. A team of a few people isn't going to build
> that. The cost of training such a system with 10^17 to 10^18 bits of useful
> knowledge is in the quadrillions of dollars, even if the hardware is free
> and the problem of brain emulation is solved. Until then, you have manual
> self improvement.


Here is how I see this exchange...

You proposed a so-called *mathematical* "debunking" of RSI.

I presented some detailed arguments against this so-called debunking,
pointing out that its mathematical assumptions and its quantification of
improvement bear little relevance to real-world AI now or in the future.

You then responded by ignoring my detailed arguments, and retreating into
informal, nonmathematical generalizations ... and furthermore, ones that
don't seem to make much sense to me (or others on this list, if the
responses are indicative...)

I don't know what you mean by "twice as smart" but I'm sure I can make more
than twice as much progress at science and engineering as someone with half
my IQ ;-p ... my IQ is around 180 whereas someone with an IQ of 90 couldn't
even understand this email let alone design an AGI or a machine learning
algorithm, etc. ... they probably couldn't even do my taxes for me ;-p

It is not clear why you think an AGI needs to be billions of times smarter
than a human to undergo dramatic RSI.  It might not need to be *any* smarter
than a smart human ... maybe an AGI with the same IQ as a smart human but an
underlying architecture built with RSI in mind, could be able to rapidly
self-improve.  In fact I strongly suspect this is the case, though I can't
prove it ... and nor can you disprove it, without making unrealistic
assumptions that render your "disproof" irrelevant!!

-- Ben G



-------------------------------------------
agi
Archives: https://www.listbox.com/member/archive/303/=now
RSS Feed: https://www.listbox.com/member/archive/rss/303/
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=8660244&id_secret=117534816-b15a34
Powered by Listbox: http://www.listbox.com

Reply via email to