A common complaint about the sudden dearth of AI generated content is that since there is so much of it, and it's so easy to generate, that there's no point in writing, or making music or art anymore.
One part of the argument is that whatever your produce will simply be consumed by the machine. The other part is that the machine will then generate so many copies that your original will never be found, so why bother?
I think that humans will always value stuff made by other humans because we are all connected to each other as conscious beings in a way that we are not connected with rocks and machines, not yet anyway.
Philosophically I find myself leaning towards dualism and panpsychism, I think there's more to reality than just the "stuff" around us, and I suspect that consciousness is fundamental and I can't draw a line in the sand where I would say, "at this level things are too simple to experience consciousness".
So I say all of that to say that conscious creations come with something extra, maybe it's simply the ability to "re-train" our own mental models on the fly. I can't prove it, but I have a very strong feeling that the words I'm writing right now aren't being driven by a non-deterministic algorithm bouncing through a matrix of weights, even if those weights are constantly being updated as each Planck second of my life ticks by.
I think it's our ability to experience consciousness that allows our models to continually update and generate new thoughts and ideas, or put them together in novel ways.
That's a very long and complicated way of saying that conscious beings have the ability to experience and enjoy their own creations, and tell you whether they think its subjectively good, in their experience or not.
In my opinion this puts the ability to create stuff that is uniquely new and good solely into the domain of conscious beings, because if you force the model to only generate "new" stuff, it will be effectively random because if you ask it to write 100 songs and pick the 10 it likes the most, it can't.
Meanwhile, actual good new content blessed as such by a conscious mind will become more and more rare, and simple supply and demand tells us what happens next.
Finally, I don't mind being consumed by the various models of the world as they inch their way towards possible consciousness, in fact I'm honored to breath my own soul into their corpus. If we are giving birth to a new form of life, my little blog posts will live forever, my own little ghost amongst many others in the machine.