LLMs Just Lie

The AI hallucination problem is well known. If you’ve used any of the LLMs with any depth, I expect you’ve encountered this. One of the hints for me has been that when I press on something or ask the question from a different angle, I get either a more confident response or sycophantic behavior. I was on a periodic evening friendship call with my three longest-standing male friends (Will Herman, Warren Katz, and Dave Jilk) when our conversation turned to LLMs. I decided to try the newest model of Gemini 2.5 Pro on what I thought was a straightforward question that would require some work. ...

June 20, 2025 · 8 min · Brad Feld