How do you program an AI to produce something that is pure creative?
It’s difficult to do. There are algorithms that try to mimic curiosity. When an AI agent is playing the creative mode in Minecraft and comes across something it didn't predict, it will be surprised, and that gives it a happy little bonus. So naturally, you'll try to seek new areas. Those type of algorithms aren't as well developed compared to maximizing an objective or win rate.