ollama/ollama

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

⭐ 163480 | 🍴 14679

ggml-org/llama.cpp

LLM inference in C/C++

⭐ 95970 | 🍴 15090

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

⭐ 71284 | 🍴 13722

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

⭐ 67599 | 🍴 8234