> -----Original Message----- > From: Matt Mahoney [mailto:[email protected]] > > I would suspect a p-conscious AGI to be more dangerous if I believed in p- > consciousness. That is because I would also assume it had free will. But free > will is also an illusion. It is caused by positive reinforcement of actions. > Again, > we have it because it increases our reproductive fitness. You would not want > to live if you did not enjoy doing things. The side effect of the pleasure of > doing things is that it reinforces the belief that there is a "me" that > decides to > do them, rather than deterministic neural processes sending signals to my > muscles. >
This is all overly rational. Rationality provides too simple an explanation in many cases. And one could ask are illusions real? Relegating free will to "illusion" is playing with terminology. An illusion as you refer would imply that humanly conscious beings are not responsible for their actions. P-consciousness implies responsibility to other conscious beings. If there were 2 AGI's, one p-conscious and one that merely had a belief if was p-conscious would you feel the same when unplugging each? In addition a p-conscious entity will be able to originate particular patterns that a non-conscious entity or one that merely believes it is p-conscious cannot. You might ask what happens if it learns and learns to imitate well to the point where it is perfectly indistinguishable. At that point I would say that it is then p-conscious. > We associate p-consciousness with understanding. If I want to test whether > an AGI understands me, I would test it like I would test a human. I would ask > it to rephrase what I just said. The problem is that we already have machines > that can do this. When you search on Google, it will match phrases that have > the same meaning but different words. > > We don't think Google is conscious. To me it is irrelevant as long as it > understands me. > Consciousness is a largely sub-symbolic process you can only see part of it with a language like English. Although one can be very expressive with English it as long as the rules are allowed to be broken for example with poetry. Could you input some original poetry into Google and ask how it feels about it? John ------------------------------------------- AGI Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424 Modify Your Subscription: https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657 Powered by Listbox: http://www.listbox.com
