Can qualia be separated from personhood?
Showing only ideas leading to #4803 and its comments.
See full discussion·See most recent related ideasLog in or sign up to participate in this discussion.
With an account, you can revise, criticize, and comment on ideas.(3) The programs rendering the apple imagery must be looping until stopped, since they could not have advance knowledge of when the stimulus stops.
(4) The programs rendering the apple are not people, so cannot themselves constitute experience.
(5) Repeated running of the same fixed program, not being a person, does not make it a person.
(6) Repeated running of the same fixed program is automatic, requires no creativity, and cannot constitute experience.
PROBLEM: Why are we conscious of the apple rendering? Given (6), why is there an experience of it, if the programs comprising it are looping, and so are therefore predefined?
SOLUTION: The apple programs are not the same programs one execution to the next. They are being re-evolved every time they are run. This evolution is what the person is doing, and so must be what gives rise to the experience consisting of the apple rendering.
This suggests that all experience is determined by what programs are being subjected to evolution at any given time, the niches that are being adapted to. But why is not all creativity in the mind conscious? (All consciousness might necessarily be creativity).
Either there is no unconscious creativity, or only evolutionary/creative epochs with certain properties are conscious. The most obvious candidate for the property is complexity (in the sense of sophistication): only programs (existing knowledge) of a certain sophistication, once subjected to the evolutionary process, necessitates consciousness. Complex problem solving seems to require consciousness. Meanwhile, we do not seem to be conscious of "simpler" creative tasks, like... Like what? What is a "simple" creative task? What is an example of a creative task we perform unconsciously? How could we determine it was an act of creation (new knowledge), and not an act of deductive inference of the kind characterizing AI?
"No unconscious creativity" seems the simpler option. But here we arrive again at biological evolution, which is unconscious, yet is creating knowledge. Does this serve as a distinction between explanatory knowledge and non? Explanatory knowledge can only be created by a conscious process?
A person could create the same knowledge that biological evolution does, if only by simulating it. But it could still be true that only people can create explanatory knowledge. (That they can create all possible explanatory knowledge is Deutsch's criterion for personhood.)
only people can create explanatory knowledge
How is an LLM not creating new explanatory knowledge (even if worse than the existing, by any measure), by varying some existing written explanation? It could even vary and select by some criterion of its "choice", thus realizing Popperian epistemology.
Whatever new "explanations" it creates are derivable from (and by?) the knowledge in the training data. It isn't evolution if all of the variations and selection criteria are stored ahead of time. That's just a search process, as in the case of Move 37 per AlphaGo.
If only some of the criteria are stored, and the rest are random, is it still evolution? Is evolution only happening if there is random variation? But we could program an LLM to do that as well...
But an AI programmed to make random variations to its conjectures (English or otherwise) can only do so by choosing from an existing set of variations. Again, that knowledge is pre-existing. True evolution must involve variations to the substrate on which the knowledge is based; variations must be agnostic to the semantics of whatever they are acting upon, else they are already implicit from it, in which case their application does not constitute a truly novel conjecture (in the sense defining creativity).
Even if variations are agnostic to any meaning or context of the knowledge, why are they still not implicit? Anything is implicit from anything else, if implicit just means: follows from when a given change is applied... The whole question is where the change is coming from... (?)