Guidance
Guidance language for controlling LLM generation with constraints, grammars, and JSON schemas.
About
Guidance is a language for programmatically controlling large language models through constrained generation. It supports regex patterns, context-free grammars, and JSON schemas, and integrates with Transformers, llama.cpp, and OpenAI-compatible APIs. The framework saves tokens through fast-forwarding by pre-filling tokens implied by the grammar instead of always sampling.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Frameworks & Libraries
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- MIT
- Added
- May 7, 2026
Related Tools
Tensor library for machine learning on commodity hardware
Structured output extraction from LLMs with Pydantic
Deploy LangChain runnables as REST APIs
Unified system for large-scale distributed training and inference.
High-level deep learning library making neural nets accessible with best practices.
Open-source machine learning framework by Meta with dynamic computation graphs.
Mentioned in
SGLang and the Structured-Output Renaissance
Constrained generation used to be a library you bolted on. It is becoming a feature of the inference engine....
Max P
DSPy and the Rise of Programmatic Prompting
DSPy reframes prompts as code that can be compiled and optimized. Here is what that actually means, why it...
Max P