Then you look at the logs and realize your LLM calls are mostly chewing on… JSON syntax.
At some point, many of us have had a similar experience:
You ship an “AI feature” that works.Then you look at the logs and realize your LLM calls are mostly chewing on… JSON syntax.