Sign in

AirLLM

AirLLM 70B inference with single 4GB GPU

6.8 Open source36.8k
AirLLM homepage
github.com · captured 2026-10-12

Our verdict

A usable project with some maintenance caveats. This assessment is derived from GitHub's own repository metrics on 2026-10-12, not from hands-on testing.

AirLLM 70B inference with single 4GB GPU. The project is written primarily in Jupyter Notebook, released under Apache-2.0, and has 36,847 stars and 3,834 forks on GitHub. 10 contributors have committed to it, and the most recent push was 2026-10-12. The latest tagged release is v4.0.0 (2026-09-05). Figures come from the GitHub API on 2026-10-12 and are refreshed daily; the score below weighs adoption, maintenance, release discipline, contributor breadth, licence clarity and issue hygiene.

Reviewed by AI Review Rating from GitHub API data How we score

RepositoryGitHub API, refreshed daily

36.8kStars
3.8kForks
306Watching
10Contributors
161Open issues
Licence
Apache-2.0
Language
Jupyter Notebook
Last push
2026-10-12
View on GitHub

Releases

  1. v4.0.0 AirLLM v4.0.0 - train Qwen3.8-Flash-Next under 6GB
  2. v3.3.0 AirLLM v3.3.0 - Qwen3.8-Flash-Next on 5.95GB
  3. v3.2.0 AirLLM v3.2.0 - Qwen3.8-27B on 3.33GB
  4. v3.1.0 AirLLM v3.1.0 - Kimi K3 (2.8T) on a single card
  5. v3.0.1 AirLLM v3.0.1
  6. v3.0.0 v3.0.0

Pros and cons

Pros

Cons

Pricing

  • Free tierYes
  • LicenceApache-2.0
  • Self-hostYes, source is public
  • Public price listNot published

AirLLM does not publish a web price list. For consumer apps that usually means pricing appears inside the product; for enterprise tools it means talking to sales. Why we do this

Visit github.com

User reviews

No one has reviewed AirLLM here yet. Reviews are moderated before they appear, and our own score is editorial and separate from user ratings, though once reviews land they do lift it.

Used AirLLM? Review it.

Sign in to rate it. One account, one review per tool, so the score means something.

Create a free account Already a member? Sign in
{{ reviewsTotal }}{{ options.labels.singularReviewCountLabel }}
{{ reviewsTotal }}{{ options.labels.pluralReviewCountLabel }}
{{ options.labels.noReviewsLabel }}
{{ options.labels.newReviewButton }}
{{ userData.canReview.message }}

AirLLM alternatives

Side by side

ToolOur scoreFrom Free tierBest for
AirLLM this page 6.8 - Yes
🥇Transformers 7.9 - Yes
🥈LocalAI 7.8 - Yes
🥉GPT4Free 7.7 - Yes
Headroom 7.5 - Yes
vLLM 7.5 - Yes
Ollama 7.3 - Yes

Articles on AirLLM

Questions

Is airllm free?

Yes. airllm advertises a free tier on its own site.

How much does airllm cost?

airllm does not publish a web price list. For consumer apps that usually means pricing appears inside the product; for enterprise tools it means talking to sales.

Is airllm open source?

Yes. airllm is a public repository released under Apache-2.0. You can self-host or inspect the source directly.

How is airllm scored here?

airllm scores 6.8 out of 10. That comes from a desk review of public evidence, which is capped at 8.5 out of 10: public pricing, documentation, maintenance signals and how much we could actually verify. Affiliate relationships are excluded from scoring entirely. The full rubric is published on our methodology page.

Related