huggingface/text-generation-inference

Large Language Model Text Generation Inference

⭐ 10792 | 🍴 1255

bigscience-workshop/petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

⭐ 9972 | 🍴 593

falconry/falcon

The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.

⭐ 9804 | 🍴 980

open-falcon/falcon-plus

An open-source and enterprise-level monitoring system.

⭐ 7271 | 🍴 1520