General Discussion

.. one thing to keep in mind when thinking about AI of this sort, that is, large language models, is that there isn't any sort of "purpose" or "motivation" involved in its operation.

It is a very sophisticated version of the 10,000 monkeys pounding away on typewriters and haphazardly coming up with a Shakespeare play. It is fed a large quantity of textual material, and from it, it creates a "probabilistic web" that predicts what the next word, sentence or paragraph most probably would be given what it has ingested. Its answers are rated and the rating is fed back in to tweek the probability matrix, which is referred to as "training"

So the thing to keep in mind is that this is an entirely mechanistic process of slicing and dicing and mixing and matching words and phrases based on probabilities. There is no "will" or "purpose" or "motivation". It's just input-process-output - and, as always, garbage in, garbage out.