Some notes/review. Whether AGI is "conscious" is independent from whether it'll "rebel"/be dangerous. Answering any kind of question about consciousness doesn't answer a question about safety.
How is the situation with p-zombies atom-by-atom identical to conscious beings not resolved by saying that in this case consciousness is an epiphenomenon, meaninglessness? http://www.overcomingbias.com/2008/04/zombies.html http://www.overcomingbias.com/2008/04/zombies-ii.html http://www.overcomingbias.com/2008/04/anti-zombie-pri.html Jumping into molecular framework as describing human cognition is unwarranted. It could be a description of AGI design, or it could be a theoretical description of more general epistemology, but as presented it's not general enough to automatically correspond to the brain. Also, semantics of atoms is tricky business, for all I know it keeps shifting with the focus of attention, often dramatically. Saying that "self is a cluster of atoms" doesn't cut it. Bottoming out of explanation of experience is a good answer, but you don't need to point to specific moving parts of a specific cognitive architecture to give it (I don't see how it helps with the argument). If you have a belief (generally, a state of mind), it may indicate that the world has a certain property, that world having that property caused you to have this belief, or it can indicate that you have a certain cognitive quirk that caused this belief, a loophole in cognition. There is always a cause, the trick is in correctly dereferencing the belief. http://www.overcomingbias.com/2008/03/righting-a-wron.html Subjective phenomena might be unreachable for meta-introspection, but it doesn't place them on different level, making them "unanalyzeable", you can in principle inspect them from outside, using tools other then one's mind itself. You yourself just presented a model of what's happening. Meaning/information is relative, it can be represented within a basis, for example within a mind, and communicated to another mind. Like speed, it has no absolute, but the laws of relativity, of conversion between frames of reference, between minds, are precise and not arbitrary. Possible-worlds semantics is one way to establish a basis, allowing to communicate concepts, but maybe not a very good one. Grounding in common cognitive architecture is probably a good move, but it doesn't have fundamental significance. "Predictions" are not described carefully enough to appear as following from your theory. They use some terminology, but on a level that allows literal translation to a language of perceptual wiring, with correspondence between qualia and areas implementing modalities/receiving perceptual input. You didn't argue about a general case of AGI, so how does it follow that any AGI is bound to be conscious? -- Vladimir Nesov [EMAIL PROTECTED] http://causalityrelay.wordpress.com/ ------------------------------------------- agi Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/ Modify Your Subscription: https://www.listbox.com/member/?member_id=8660244&id_secret=120640061-aded06 Powered by Listbox: http://www.listbox.com
