Cost
Open-source engine under Apache-2.0. Model licenses and hardware requirements are separate.
Run large language models efficiently on lower end hardware.
Why it made the shelf
It is an open source GitHub repository built to run AI models on slow computers, serving as a developer and AI utility.
Best matches
See allFrom official documentation
Open-source engine under Apache-2.0. Model licenses and hardware requirements are separate.
Run local mixture-of-experts models with weights spread across disk, RAM and GPU memory.
Storage and memory needs vary by model. Limited fast memory reduces speed; the project makes no speed guarantee.
Official signals
Sourced facts from the places where this tool ships.
From GitHub
Behind the tool
People, backing, growth, and ownership. Every claim links to its source.
Source review current
Public trail
25 references from 9 publishers.