News 23 Aug 2026 · 6 views
FreeToken runs a 753B model on one workstation GPU
FreeToken is a serving engine that runs very large Mixture-of-Experts models on ordinary hardware. It splits the work between GPU and CPU, measuring bandwidth as it goes and moving experts a...