Skip to main content

What you can do with it

  • Everyday Q&A, writing, and rewriting.
  • Explaining, summarizing, and multi-turn exchanges over text.
  • Code-related questions and reasoning tasks.
Once a model is ready, inference runs locally on the device without using a cloud model service.
Check the model’s outputModel-generated content may be inaccurate. For important facts, professional decisions, or code execution, verify the results yourself.

Two model tiers

For a full comparison, see Models: 8B vs 35B.

How local inference works

Edge0 uses a sparse mixture-of-experts (MoE) model. For each generated token, the model uses only a subset of its experts and reads them from device storage on demand, so it does not need to hold all weights in memory at once. Each platform uses an inference stack suited to its hardware: Because of this, model preparation and the entry points differ by platform. Follow the guide for your platform: macOS · Windows · iOS · Android.

Current release

Both tiers are currently preview releases, and their coverage and quality are still improving. The model cards note that tool use, multi-step planning, and long-horizon autonomous tasks are not yet well optimized. For the verified test devices on each platform, see Device Requirements.

Start exploring

Go to Quick Start, choose a device and a model, and complete your first local chat.