The Modular Platform unifies AI development and deployment with an open, fully-integrated suite of libraries and tools for model serving and GenAI scaling.

- Over 450,000 lines of code from 6,000+ contributors.
- Includes MAX GPU and CPU kernels, plus the Mojo standard library.
- OpenAI-compatible REST API and Kubernetes-ready containers for NVIDIA and AMD.
- Nightly `main` branch tracks builds, with stable `max/vX.X` release branches.

Explore it here:
https://www.opensourceprojects.dev/post/mojo

Every month, developers pay to run three models:

DeepSeek V4 Flash: $0.14 in, $0.28 out per million tokens
DeepSeek V4 Pro: $0.435 in, $0.87 out per million tokens
GLM 5.2: $1.40 in, $4.40 out per million tokens
GLM Coding Plan: $18 to $160 a month

Cheap. Not zero. And every prompt goes to a server on the other side of the world.

Now meet ds4.

An inference engine that runs DeepSeek V4 Flash, DeepSeek V4 Pro, and GLM 5.2 directly on your own machine.

No API key. No bill. No data leaving your laptop.

19,691 stars. 1,743 forks. MIT license. Pure C. 87 days old.

The builder is Salvatore Sanfilippo. The same guy who wrote Redis. He got tired of pinging a server every time he wanted an answer and shipped his own local runtime.

What it runs on:

Apple Metal on Macs with 96 GB or more
NVIDIA CUDA, single or multi-GPU, including DGX Spark
AMD ROCm on Strix Halo
SSD streaming for smaller machines
Two-Mac RDMA tensor parallelism
100% offline

Speed on a MacBook Pro M5 Max 128 GB, short prompt:
87 t/s prefill.
34 t/s generation.

That is frontier open-model speed on a laptop you already own.

Cost to run it.

Zero. Forever.

Your model. Your machine. Your data.

MIT licensed. Pure C. Yours forever.

(Link in the comments)