On 4/8/2021 12:38 PM, Jason Resch wrote:
Hi Telmo,
Thank you for these links, they are very helpful in articulating the
problem. I think you are right about there being some connection
between communication of qualia and the symbol grounding problem.
I used to think there were two kinds of knowledge:
1. Third-person sharable knowledge: information that can be shared
and communicated through books, like the population of Paris, or
the height of Mount Everest
2. First-person knowledge: information that must be felt or
experienced first hand, emotions, feelings, the pain of a bee
sting, the smell of a rose
But now I am wondering if the idea of third-person sharable knowledge
is an illusion. The string encoding the height of Mount Everest is
meaningless if you have no framework for understanding physical
spaces, units of length, spatial extents, and the symbology of
numbers. All of that information has to be unpacked, and eventually
processed into some thought that relates to a basis of conscious
experience and understanding of heights and sizes. Even size is a
meaningless term when attempting to compare relative sizes between two
universes, so in that sense it must be tied somehow back to the subject.
There also seem to be counter-examples to a clear divide between
first- and third-person knowledge. For example, is the redness of red
really incommunicable between two synesthesiacs who both see the
number *5* as red? If everyone in the world had such synesthesia,
would we still think book knowledge could not communicate the redness
of red? In this case, what makes redness communicable is the shared
processing between the brains of the synesthesiacs, their brains
process the symbol in the same way.
I think you exaggerate the problem. Consider how bats "see" by sonar.
I think this is quite communicable to humans by analogies. And
submarines have sonar which produces images on screens. Is redness
communicable? My father who was red/green color blind had to guess at
the color of traffic lights or just watch other cars when he first
started to drive around 1928. But he understood the concept of color
because he could tell blue from red/green. And later, traffic engineers
adjust the spectrum of traffic lights so that he could tell the
difference (they also started to put the red at the top).
Brent
More comments below:
On Thu, Apr 8, 2021 at 11:11 AM Telmo Menezes <[email protected]
<mailto:[email protected]>> wrote:
Hi Jason,
I believe that you are alluding to what is known in Cognitive
Science as the "Symbol Grounding Problem":
https://en.wikipedia.org/wiki/Symbol_grounding_problem
<https://en.wikipedia.org/wiki/Symbol_grounding_problem>
My intuition goes in the same direction as yours, that of
"procedural semantics". Furthermore, I am inclined to believe that
language is an emergent feature of computational processes with
self-replication. From signaling between unicellular organisms all
the way up to human language.
That is interesting. I do think there is something self-defining about
the meaning of processes. Something that multiplies two inputs can
always be said to be multiplying. The meaning of the operation is then
grounded in the function and processes of that process, which is made
unambiguous. The multiplication process could not be confused with
addition or subtraction. This is in contrast to a N-bit string on a
piece of paper, which could be interpreted in at least 2^N ways (or
perhaps even an infinite number of ways, if you consider what function
is applied to that bit string).
Luc Steels has some really interesting work exploring this sort of
idea, with his evolutionary language games:
https://csl.sony.fr/wp-content/themes/sony/uploads/pdf/steels-12c.pdf
<https://csl.sony.fr/wp-content/themes/sony/uploads/pdf/steels-12c.pdf>
Evolving systems that can communicate amongst themselves seems to be a
fruitful way to explore these issues. Has anyone attempted to take
simple examples, like computer simulated evolved versions of robots
playing soccer, and add in a layer that lets each player emit and
receive arbitrary signals from other players? I would expect there
would be strong evolutionary pressures for learning to communicate
things like "I see the ball", "I'm about to take a shot", etc. to
other teammates.
I have been working a lot with language these days. I and my
co-author (Camille Roth) developed a formalism called Semantic
Hypergraphs, which is an attempt to represent natural language in
structures that are akin to typed lambda-calculus:
https://arxiv.org/abs/1908.10784 <https://arxiv.org/abs/1908.10784>
One curiosity is that all human languages appear to be "Turing
complete" in the sense that we can use natural language to describe
and define any finite process. I don't know how significant this is
though, as in general it is pretty easy to achieve Turing complete
languages.
I think the central problem with "Mary the super-scientist
<https://en.wikipedia.org/wiki/Knowledge_argument>" is our brains, in
general, don't have a way to take received code/instructions and
process them accordingly. I think if our brains could do this, if we
could take book knowledge and use it to build neural structures for
processing information in specified ways, then Mary could learn what
it is like to see red without red light ever hitting her retina. But
such flexibility in the brain would make us vulnerable to "mind
viruses" that spread by words or symbols. Modern computers clearly
demarcate <https://en.wikipedia.org/wiki/NX_bit> executable and
non-executable memory to limit similar dangers.
This might also explain the apparent third-person / first-person
distinction. We can communicate through language any Turing machine,
and understand the functioning of that machine and processing in a
third person way, but without re-wiring ourselves, we have no way to
perceive it in a direct first-person way.
Here's the Python library that implements these ideas:
http://graphbrain.net/ <http://graphbrain.net/>
Very cool!
So far we use modern machine learning to parse natural language
into this representation, and then take advantage of the
regularity of the structures to automatically identify stuff in
text corpora for the purpose of computational social science research.
Something I dream of, and intend to explore at some point, is to
attempt to go beyond the parser and actually "execute the code",
and thus try to close the loop with the idea of procedural semantics.
I have often wondered, if an alien race discovered an english
dictionary (containing no pictures) would there be enough internal
consistency and information present in that dictionary to work out all
the meaning? I have the feeling that because there is enough
redundancy in it, together with a shared heritage of evolving in the
same physical universe, there is some hope that they could, but it
might involve a massive computational process to bootstrap. Once they
make some headway towards a correct interpretation of the words,
however, I think it will end up confirming itself as a correct
understanding, much like the end stages of solving a Sudoku puzzle
become easier and self-confirming of the correctness of the solution.
Is this the problem you are attempting to solve with the semantic
hyper graphs/graph brain, or that such graphs could one day solve?
Jason
Am Mi, 31. Mär 2021, um 17:58, schrieb Jason Resch:
I was thinking about what aspects of conscious experience are
communicable and which are not, and I realized all communication
relies on some pre-existing shared framework.
It's not only things like "red" that are meaningless to someone
whose never seen it, but likewise things like spatial extent and
dimensionslity would likewise be incommunicable to someone who
had no experience with moving in, or through, space.
Even communicating quantities requires a pre-existing and common
system of units and measures.
So all communication (inputs/outputs) consist of meaningless but
strings. It is only when a bit string is combined with some
processing that meaning can be shared. The reason we can't
communicate "red" to someone whose never seen it is we would need
to transmit a description of the processing done by our brains in
order to share what red means to oneself.
So in summary, I wonder if anything is communicabke, not just
qualia, but anything at all, when there's not already common
processing systems between the sender and receiver, of the
information.
Jason
--
You received this message because you are subscribed to the
Google Groups "Everything List" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to [email protected]
<mailto:[email protected]>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/everything-list/CA%2BBCJUhC%3Dq%3D1t6mQzo%2BLLZCOrpXFK9etNojhQ-hgb%2BZaE2wr0A%40mail.gmail.com
<https://groups.google.com/d/msgid/everything-list/CA%2BBCJUhC%3Dq%3D1t6mQzo%2BLLZCOrpXFK9etNojhQ-hgb%2BZaE2wr0A%40mail.gmail.com?utm_medium=email&utm_source=footer>.
--
You received this message because you are subscribed to the Google
Groups "Everything List" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to [email protected]
<mailto:[email protected]>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/everything-list/60bab9c1-98a1-4001-830f-fd7a469b3a8d%40www.fastmail.com
<https://groups.google.com/d/msgid/everything-list/60bab9c1-98a1-4001-830f-fd7a469b3a8d%40www.fastmail.com?utm_medium=email&utm_source=footer>.
--
You received this message because you are subscribed to the Google
Groups "Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to [email protected]
<mailto:[email protected]>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/everything-list/CA%2BBCJUgWHah6t6fAoAKd7kZ6Ch%3D-WPL%2BzLwqa1J0psVrKC-oJQ%40mail.gmail.com
<https://groups.google.com/d/msgid/everything-list/CA%2BBCJUgWHah6t6fAoAKd7kZ6Ch%3D-WPL%2BzLwqa1J0psVrKC-oJQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.
--
You received this message because you are subscribed to the Google Groups
"Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/everything-list/3efb84d8-39bd-0a7e-e00e-106c44fafc8c%40verizon.net.