Weights Merging (mergekit)
Toolkit for merging multiple LLMs into a single model.
About
mergekit by Arcee AI is a toolkit for merging the weights of multiple pretrained language models into a single model without further training. It implements merge methods including linear, SLERP, TIES, DARE, and passthrough, and uses an out-of-core approach so elaborate merges run on CPU or with as little as 8 GB of VRAM. It is widely used to create custom model blends. Released under the LGPL-3.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Model Training & Fine-Tuning
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
No-code tool by Hugging Face for training ML models automatically.
Efficient LLM quantization preserving important weight channels.
Video model fine-tuning toolkit by Hugging Face Diffusers team.
Low-code framework for building custom AI models by Predibase.
Library for training LLMs with reinforcement learning (RLHF, DPO, PPO).
Efficient fine-tuning method using 4-bit quantized base model with LoRA adapters.