I think the next big AGI company should be named: FOOM!!
(With the exclamation points. That would certainly get people's attention). ~PM > Date: Mon, 19 Jan 2015 14:47:29 -0500 > Subject: Re: [agi] Aubrey de Grey vs self-improving machines > From: [email protected] > To: [email protected] > > On Sat, Jan 17, 2015 at 6:37 PM, Tim Tyler via AGI <[email protected]> wrote: > >> de Gray is arguing against the scenario where a recursively self > >> improving AI in a box goes FOOM! > > > > It seems like a straw man scenario. Has anyone seriously proposed it? > > There are some old proposals, for example Corwin's experiments on > containing AI in 2002. > http://www.sl4.org/archive/0207/4935.html > > Yudkowsky's Coherent Extrapolated Volition in 2004. > https://intelligence.org/files/CEV.pdf > > Of course this was before Google and Facebook got good at recognizing > images and natural language text. It was not so apparent then as now > that the internet is becoming AGI. Of course you cannot contain it or > turn it off. In order for AGI to gain human knowledge, it has to > interact with humans. > > Also, the internet looks like much less of a threat than a paperclip > maximizer. We understand that AGI is not a powerful optimization > process with a simple goal. We don't tell computers what to do. We > tell them how to do it because it is faster to share our own knowledge > than for it to figure it out on its own. There is simply no such thing > as a general purpose learning algorithm that you can give an arbitrary > goal to. Mathematically, there never will be. > > >> Most of what AI in general already knows comes from humans. AI cannot > >> learn human knowledge faster than humans can communicate, about 5-10 > >> bits per second, but that is faster than anything else. > > > > Machines can easily learn about all the images and videos freely available > > on the > > internet. They can slurp that information up over as many T1 lines as you > > have > > going into your data center. There's no 5-10 bits per second limit. > > Machines can only learn rapidly the things we already know. There are > some important questions that even very powerful computers cannot > answer quickly. Among the most important are how we can live longer. > Ray Kurzweil takes 100 pills a day, hoping to live to see the > singularity in 2045 and be immortal. But there is a problem. There is > not a single pill of any kind that is known to increase life > expectancy. It would take decades to find out. > > Sure, we have in-vitro and animal models. We can learn very quickly > that calorie restriction extends the life spans of fruit flies and > mice. We don't know if it works on monkeys. After decades of > experiments, it worked on one group but not another. There have been > no experiments on humans. We know that children reach puberty at a > younger age now than 100 years ago, probably due to more calories, but > people are also living longer. Calorie restriction probably works by > slowing growth. Fish convert 90% of what they eat into growth and 10% > to energy. Cattle convert 15% of their food to growth. Humans convert > 0.3%. > > We suspect that rapamycin and sirtuins mimic calorie restriction, but > the results are not conclusive and these drugs can have serious side > effects. Rapamycin suppresses the immune system. Some studies say that > light drinking increases life expectancy. Others say that any alcohol > increases the risk of cancer. We once thought that vitamin supplements > helped, but later studies proved that false. We thought that low fat > diets helped, but later studies found they did more harm than good. We > thought that a low salt diet helped, but later studies refuted that. > We thought that sunscreens helped, but skin cancer rates have been > increasing in tandem with sunscreen use. It turns out that sunscreens > block UVB but not UVA, and actually increase exposure to UVA (95-99% > of UV depending on angle of sun) because it is UVB that gives you a > tan, and a tan blocks UVA. SPF is rated by UVB blockage only. > > My point is that all of this knowledge took decades to learn, and the > problem is getting worse. New drugs now cost $2 billion to develop. > The cost doubles every 9 years. The rate of increase of life > expectancy has peaked at 0.2 years per year in the 1990's and is > declining. It peaked in the 1970's in developed countries. > > One would hope that we could build computer models of the human body > that would allow us to answer these questions faster. But we do not > have computer models of even simple chemistry. There is no program > that inputs a formula like H2O and calculates the freezing point of > water. The reason is that modeling the movement of atoms requires > solving Schrodinger's equation, which has exponential time complexity > except on a quantum computer. But even a quantum computer is no faster > than doing the actual experiment because all you have is an > exponential speedup of an exponentially slowed down algorithm. A > simulation always requires more computation and is less accurate than > the actual experiment. > > And of course, the human body is much more complex than H2O. The brain > executes 10^16 synapse operations per second on 10^14 synapses. The > body executes 10^20 DNA, RNA, and amino acid operations per second on > 10^23 bits of DNA. Even if Kurzweil's prediction of computing capacity > catching up with the brain in 2045, we will still be a long way from > simulating the body. After robots automate everything that humans can > do with their brains, senses, and muscles, there will still be plenty > of jobs testing experimental drugs. > > -- > -- Matt Mahoney, [email protected] > > > ------------------------------------------- > AGI > Archives: https://www.listbox.com/member/archive/303/=now > RSS Feed: https://www.listbox.com/member/archive/rss/303/19999924-4a978ccc > Modify Your Subscription: https://www.listbox.com/member/?& > Powered by Listbox: http://www.listbox.com ------------------------------------------- AGI Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424 Modify Your Subscription: https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657 Powered by Listbox: http://www.listbox.com
