Sycophancy in LLMs is a real problem. Here's a paper from Anthropic talking about it:

https://arxiv.org/abs/2310.13548