On Fri, Apr 16, 2021, 8:17 PM <[email protected]> wrote:

> I like the part he says:
>
> *Once human level AGI is achieved, how long would you expect it to take
> for it to self-modify its way up to massive superhuman intelligence?*
>
> *HY: *If human-level AGI is achieved, it could take on the role of an AI
> researcher itself. Therefore, immediately after the AGI is built, it could
> start rapidly cultivating great numbers of AI researcher AI’s that work
> 24/7, and AI R&D would be drastically accelerated.
>
I like the part where he said that Astro Boy is a robot. When I was a kid I
thought he was a boy that flew around in his underwear.

But his point about the ethical treatment of blends of humans and robots is
noted. I think it is dangerous to give AI any human rights at all, as they
could be programmed not to be constrained by human ethics and could exploit
our ethics for their owners gain. Why would we ever build machines that
compete with us for resources?

I don't believe the mainstream model of the Singularity that he describes.
AGI researchers don't produce AGI without living in a technologically
advanced civilization. Civilization is already self improving and has been
for thousands of years. There isn't some threshold that needs to be crossed
first. Robots passing the Turing test won't drastically accelerate
progress. Experiments on human longevity will still take decades.

I think we will face a threat when 3D nanoscale printers become as cheap as
computers and anyone can experiment with self replicating nanotechnology
and artificial pathogens. At the current rate of Moore's Law, that should
happen in the 2080s.

Before that happens we also risk letting AI do too much thinking for us. We
already saw how social networks can separate us into news bubbles with
drastically different views of the world. We are already losing control.

------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/T05f9e3871800e2db-M7feb32bc25315b152c4ff4c3
Delivery options: https://agi.topicbox.com/groups/agi/subscription

Reply via email to