Are AI models narrowly creative?
#4683·Tyler MillsOP, about 5 hours agoAIs have created output that is not only novel, but seems to constitute new knowledge (resilient information), such as the famous Move 37 from AlphaGo. That is new knowledge because the move was not present in the training data explicitly, nor did the designers construct it.
This seems to me to be the same distinction that Deutsch and others have made between the genetic evolution we can simulate through evolutionary algorithms and the kind we actually observe in nature. I think it would be helpful to investigate evolutionary algorithms a bit further if you want to develop a clear distinction. This is how I describe it in my book:
There are several mechanisms that genes use to create variants, including sex, mutation, gene flow, and genetic drift, all of which appear to introduce change randomly. But we now know it cannot be entirely random. Something more is shaping what gets trialed, because when we model and simulate evolution using random changes, we never see the sort of novelties that arose in nature. We see optimization. We see exploitation. We see organisms become better at using resources they already use. But we never see a genuinely new use of a resource emerge. A fin may become better at swimming, but it does not become a limb. A metabolism may become more efficient, but it does not open up an entirely new biological pathway. And yet the natural world is full of exactly such extraordinary adaptations.
#4683·Tyler MillsOP, about 5 hours agoAIs have created output that is not only novel, but seems to constitute new knowledge (resilient information), such as the famous Move 37 from AlphaGo. That is new knowledge because the move was not present in the training data explicitly, nor did the designers construct it.
Move 37 was not explicitly present in the training data, nor designed by the programmers, and is extremely hard to vary (Deutsch's criterion for good explanations). Was the move present implicitly in the design of the system and/or the training data? Or inexplicitly? Does either of these mean the discovery of the move was non-creative?
#4683·Tyler MillsOP, about 5 hours agoAIs have created output that is not only novel, but seems to constitute new knowledge (resilient information), such as the famous Move 37 from AlphaGo. That is new knowledge because the move was not present in the training data explicitly, nor did the designers construct it.
Since evolution created genetic knowledge from nothing, it can be said to have the same "narrow creativity" as AI. The confusion over whether AI "is creative" can be resolved by saying that it is, but only narrowly (like evolution), and that the creativity defining people is universal, not limited to any domain. AI creates knowledge in domains it was designed for; AGI can create knowledge in all possible domains, each of which it designs itself.
Recent conversations have revealed that I cannot argue against the notion that current AI systems create new knowledge (and so are creative in some domain). Yet, David Deutsch has argued that creativity is a binary property of programs, and those that have it are people (including AGIs), who can create all possible explanatory knowledge. I am not of the mind that current AI is AGI. So I will try to iron all this out, here.
AIs have created output that is not only novel, but seems to constitute new knowledge (resilient information), such as the famous Move 37 from AlphaGo. That is new knowledge because the move was not present in the training data explicitly, nor did the designers construct it.