“For example, you can ask these LLMs to create code and they sometimes make up a framework, or an imaginary library or module, to do what you want it to do,” Taulli said, explaining that the LLMs were not creating a new framework as much as pretending that they created it, but they actually didn’t.
That is the sort of behavior that LLM coding will do that almost no human programmer would even consider doing, Taulli noted, adding, “unless (the human coder) is insane, they are not going to make up, create out of thin air, an imaginary library or module.”
When that happens, it can be easy to detect, if someone looks for it. “If I try to pip install it, you can find that there’s nothing there. If it hallucinates, the IDE and compiler give you an error,” Taulli said.