5 articles

Llm

Practical Go and web development tutorials: concurrency, performance, backend architecture, testing and DevOps — with runnable code examples.

More articles

How to Test Go Code That Calls an LLM

AI Engineering

How to Test Go Code That Calls an LLM

Non-determinism does not have to mean untestable. Wrapping the model behind an interface, faking it in unit tests, golden files for prompt assembly, and the small…

 ·  10 min

Prompt Caching: The Cheapest Win in Your LLM Bill

AI Engineering

Prompt Caching: The Cheapest Win in Your LLM Bill

Prompt caching is a prefix match, and one stray timestamp can silently disable it. How cache breakpoints, TTLs and the usage fields actually work — and how to build…

 ·  10 min