FreeToken Unlocks Frontier MoE Inference on Consumer Hardware via Dynamic Co-Execution

Researchers from UC Berkeley and MIT have developed FreeToken, an open-source inference engine that enhances the utility of Mixture-of-Experts models on consumer hardware. By implementing a dynamic scheduling policy and optimising weight management, FreeToken improves decoding speeds and execution e

Related Stories

OpenAI Releases GPT-6 Astra for Coding and Computer Use

1.1.1.1 now supports post-quantum DNSSEC, all 2,420 bytes of it

Introducing the Google Cloud Developer Plugin for AI Coding Agents

📰

Introducing Amazon EBS Volume Clones across AWS accounts