The more relevant question on the future of LLM's is the curse of recursion - will we eventually get an AI equivalent of mad cow disease? See https://arxiv.org/pdf/2305.17493.pdf