The LLMs are even worse than just making mistakes. Usually when a person makes a mistake they aren’t incredibly confident in their statement. An LLM will say something with language that imitates confidence, which makes people believe it actually knows stuff. However, if you tell it it’s wrong, even if it actually is right, it will also almost always agree with you. It’s as accurate as rubbing a crystal ball. You may get something out of it, but it’s always going to reflect back your beliefs.
The LLMs are even worse than just making mistakes. Usually when a person makes a mistake they aren’t incredibly confident in their statement. An LLM will say something with language that imitates confidence, which makes people believe it actually knows stuff. However, if you tell it it’s wrong, even if it actually is right, it will also almost always agree with you. It’s as accurate as rubbing a crystal ball. You may get something out of it, but it’s always going to reflect back your beliefs.