Statistical inference ≠ judgement
LLMs are statistical inference machines. They build heatmaps of probability. Vectors. Euclidean geometry tuned to guess the correct answers as defined by their creators.
Judgement requires experience. Pain and suffering. Temptations and avoidance. Risks and rewards.
Statistical inference cannot embody experience. It can only guess. It is a very skilled guess to be sure, but it is nothing more than a guess.