Run a model far larger than your machine by streaming its weights off disk
Why this one
- run a frontier-sized model on hardware you already own
- try a large model without renting a GPU box
- read how streamed expert weights work in plain C
On the record
- Free
- No signup
Last checked 1 day ago