Guidance

Guidance by Microsoft is a programming paradigm for steering language model generation. It lets you constrain output with regular expressions, JSON schemas, and context-free grammars and interleave control flow such as conditionals, loops, and tool use with generation, which improves structure while reducing latency and cost. It supports backends including Transformers, llama.cpp, and OpenAI. Released under the MIT license.