Transformers
7.9🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal…
LLM Infrastructure
164.4k
Free tier
Best LLM Infrastructure Tools
LLM infrastructure tools, each scored against our published rubric. Our LLM serving stacks guide checks which engines are still maintained. The self-hosting break-even works out when a GPU beats paying per token.
53 tools, each scored against our published methodologyThere are 53 LLM Infrastructure tools here. 56.6% have a free tier, and the median score is 4.2. Paid is the most common pricing model at 43.4%.
53Tools
56.6%Free tier
37.7%Open source
4.2Median score
Pricing breakdown
- Paid 43.4%
- Open source 37.7%
- Freemium 18.9%
Guides covering LLM Infrastructure tools
All articles →
Best Open Source LLM Serving Stacks in 2026: Hugging Face Archived TGI and Named Its Replacements, and One Identical Model Bills $0.17 or $0.95 per Million Output Tokens Depending on Who Runs It
Hugging Face archived text-generation-inference, the stack Google still ranks fourth for this query, and its README…
Self-Hosting an LLM in 2026: A Small Team Needs 675 Tokens a Second, Nonstop, Before a $244.80 GPU Beats a $0.14 API
A $244.80 a month RTX 4090 on Runpod Community Cloud only beats Together AI Llama 3…
Fine-Tuning an LLM in 2026: The Same 30-Million-Token Run Bills $12 or $90, and One Platform Google Recommends Has Redirected Its Whole Domain to Another Company
A LoRA supervised fine-tune of gpt-oss-20B on 30 million training tokens bills $12.00 on Together AI…
Open Source Alternatives to Paid AI Tools in 2026: $560.50 a Month Off a Small Team’s Bill, and the Three Licences That Decide If You Can
A small team on Zapier, Pinecone, Algolia, Datadog, 5 ChatGPT seats and ElevenLabs pays $560.50 a…
This Week in AI Tools: Oct 5, 2026
Every week we publish what changed across the 1,695 AI tools we have scored, plus a…
