RWKV
RNN-based language model with transformer-level performance and linear scaling.
About
RWKV is a language model architecture that blends the training parallelism of transformers with the linear-time, constant-memory inference of recurrent networks, using no key-value cache. The RWKV-7 generation is attention-free and updates its state in context at every token, suiting long-context and multimodal use, and models range from small to 14B parameters. It is a Linux Foundation AI project. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Large Language Models (LLMs)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Minimum VRAM
- 4 GB
- Added
- Apr 3, 2026
Related Tools
Open-weight models by Google in 2B, 9B, and 27B sizes with strong performance.
Open-weight LLM by Meta in 8B and 70B sizes with strong general capabilities.
Open-weight LLM family by Alibaba with strong multilingual and coding abilities.
Small language model by Microsoft in 3.8B size with strong benchmark performance.
Open-access 176B parameter multilingual LLM by BigScience supporting 46 languages.
Retrieval-augmented generation optimized LLM by Cohere with 128K context.