On Sat, Oct 25, 2014 at 8:07 PM, Stanley Nilsen via AGI <[email protected]> 
wrote:
> The original comment was regarding a person being " a thousand times more
> aware / conscious"  My focus was more on what it means to be 1000 times more
> aware / conscious.

Sorry, my mistake. There are multiple meanings of "consciousness" and
I did not clarify.

1. The mental state of wakefulness, in which thoughts and perceptions
are written into episodic memory.
2. Qualia, or that which makes you different from a p-zombie.
3. A property of agents that makes it immoral to harm them.

So I was assuming (2) when the context implies (1), as in capable of
learning 1000 times faster, as if time were slowed down by a factor of
1000, or if its sensory and processing capabilities were extended in
such a way that it could hold 1000 conversations simultaneously. Or
perhaps 1000 times as intelligent, if we could agree on a suitable
test.

The original question was how I would react to this agent that always
knew what I was thinking and could anticipate my actions, but always
acted in my best interests. Well, I'm not sure. Suppose it suggested
that I could become immortal and have greatly enhanced mental
capabilities (1000x more) by pretending to be me. All I have to do
kill myself to complete the upload. I mean, logically it certainly
seems to be in my best interest to take its advice. Well, I'm not sure
I would trust it, since it would know I would initially refuse, and I
would know it would take action anyway based on my extrapolated
volition.

-- 
-- Matt Mahoney, [email protected]


-------------------------------------------
AGI
Archives: https://www.listbox.com/member/archive/303/=now
RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657
Powered by Listbox: http://www.listbox.com

Reply via email to