Misc. Conjectures Re: AGI and Evolution

Conversely, non-inferential novelty does not follow by any inference or deduction; it is not implicit in existing knowledge, so it is not in any set of knowledge's implication space (except that of the laws of physics...).

Knowledge which is novel in this way is what constitutes creation in the sense we mean in epistemology. The two known examples of non-inferential knowledge growth are biological evolution and some of the thinking which takes place in the minds of people (human or AGI).

Any given set of knowledge cannot grow itself non-inferentially. There must be a source of novelty, of variation, that is epistemically external to it.
If we take that claim as general, then the mutation of DNA constituting the creation/novelty/knowledge-growth in biology is a specific instance: cosmic ray strikes and errors in copying due to chemistry are sources of variation not caused by the DNA’s knowledge).

Claim: It is useful (if not crucial) to distinguish between two notions of novelty: inferential and non-inferential.

Knowledge that is inferentially novel may never have been seen before, but was already implicit in existing knowledge; it results from application and composition of existing knowledge (e.g. the running of programs). What is novel in this way can be instantiated without any external epistemic (knowledge-related) influence. A program needs infrastructure to allow its computation to occur; it does not need another program, in an epistemic sense: If there's a dependency, we should consider the two to be part of the same "epistemic system." Let's say the dependent target has no "implication space" until its needed source is causally linked to it. The source may have its own implication space. Once "joined," a new implication space is defined.

Inferentially novel output (the instantiation of knowledge in an implication space) is all that current computer software (and all AI) is capable of. These systems "create" knowledge only in this sense.

If other criteria for the selection of conjectures were built into the system, such as in the genes of a human, the growth of knowledge would be bounded to only conjectures meeting those criteria, even if the variation/conjecture aspect of the process were proceeding via a random process with no built-in knowledge. Fixed criteria means bounded knowledge, means no universality. So for unbounded progress (universality), the criteria must also be varied. But how are they criticized? What criteria for their selection can there be to avoid a regress, except survival?

All subsequent knowledge in the system will be descended from the initial knowledge. So all knowledge in a knowledge-growing system must be either created by or comprised of replicators.

Seeking criticism of various ideas relating to ongoing research into AGI, creativity, personhood and open-ended evolution.

Knowledge growth (such as in genes in the biosphere, or in a person) can only proceed by conjecture and criticism -- variation and selection. In a system which can create knowledge, but has not yet, there are no modes of substantive criticism available, since that would itself require knowledge. So how can the system create knowledge at all? Because although substantive criticism is not yet possible, the crudest form of full-on refutation is: the destruction of the information medium on which a conjecture is based, i.e., death. Death is the only "undesigned" refutation. So any initial knowledge created in an otherwise empty knowledge-creating system can only be that relating to how to avoid death in the local environment. This is the knowledge which defines replicators.