AI agents · OpenClaw · self-hosting · automation

Quick Answer

Kimi K3 Self-Hosting Guide: Open Weights July 27 (2026)

Published:

Kimi K3 Self-Hosting Guide: Open Weights July 27 (2026)

On July 16, 2026, at WAIC 2026 in Shanghai, Moonshot AI released Kimi K3 — a 2.8-trillion-parameter Mixture-of-Experts model with a 1-million-token context window — and promised full open weights by July 27, 2026 under a Modified MIT license. That makes K3 the largest open-weight model ever released, and one of the first frontier-tier models where self-hosting is economically viable for teams above ~200M tokens/day.

Here is what you need to know: pricing today, weights availability, hardware requirements, and when self-hosting beats the API.

Last verified: July 18, 2026

What Was Announced

  • Date: July 16, 2026, at WAIC 2026 (Shanghai).
  • Model: Kimi K3 — 2.8T total parameters, MoE with 16 of 896 experts active per token (~50B active).
  • Context: 1 million tokens, native multimodal (vision).
  • Weights release: July 27, 2026 (Modified MIT license). Hugging Face + Moonshot registry.
  • API pricing (available now via Kimi API):
    • Input (cache-miss): $3.00 / MTok
    • Input (cache-hit): $0.30 / MTok
    • Output: $15.00 / MTok

Moonshot’s own benchmarks claim K3 beats Fable 5 and GPT-5.6 Sol on frontend code arena benchmarks, and beats Opus 4.8 and GPT-5.5 on its internal coding/agentic evaluation suite — while acknowledging K3 generally lags Fable 5 and Sol on overall difficulty.

The Pricing Comparison (July 18, 2026)

ModelInput $/MTokOutput $/MTokContextWeights
Kimi K33.0015.001MYes (Jul 27)
Claude Sonnet 55.0025.001MNo
Claude Opus 4.85.0025.001MNo
Claude Fable 510.0050.001MNo
GPT-5.6 Solnot yet publicnot yet public400KNo
Gemini 3.5 Pro15.0060.002MNo
MiniMax M30.602.401MYes (MIT)
DeepSeek V4 Pro0.440.871MYes (MIT)

Read: K3 is priced to undercut Fable 5 heavily, undercut Gemini 3.5 Pro by 5×, and match Sonnet 5. It is priced above MiniMax M3 and DeepSeek V4 Pro — the trade-off is claimed higher performance at the top of the Chinese open-weight range.

Hardware for Self-Hosting K3

K3 is a big model. Rough sizing (FP8 vs MXFP4 checkpoints):

SetupGPUGPUsPurposeApprox cost (hardware)
FP8 minimumH200 141GB8Single-user, medium throughput~$260K
FP8 minimumMI325X 256GB8Single-user, medium throughput~$220K
MXFP4 quantizedH200 141GB4Single-user, decent throughput~$130K
MXFP4 quantizedRTX 6000 Blackwell 96GB8Workstation prototype~$45K
Serving clusterH200 141GB16Multi-tenant / batch~$520K

For teams: rent don’t buy. Lambda, RunPod, Together, Fireworks, and DeepInfra will all host K3 within a week of the July 27 weight drop. Expect $30-$60/hour for an 8× H200 instance. For $3-5K/month of steady rental you can serve 300-500M tokens/day.

For hobbyists: wait a week after July 27 for community MXFP4 quantizations that fit on 4× RTX 6000 Blackwell or 2× MI325X. Expect community llama.cpp / vLLM / SGLang integrations same week.

When Self-Hosting Beats the API

API wins when:

  • Traffic < ~100M tokens/day (steady).
  • You need burst capacity without pre-provisioning.
  • You care about vendor-managed uptime.
  • You are prototyping / evaluating.

Self-hosted wins when:

  • Traffic > ~300M tokens/day steady.
  • Data residency matters (e.g. cannot send to Chinese API; or must stay in EU / on-prem).
  • Custom fine-tuning is a competitive advantage.
  • Predictable latency requirements.
  • You want to swap between K3, MiniMax M3, DeepSeek V4 Pro, and GLM-5.2 based on task cost — cheaper to keep infra warm than run four API bills.

Break-even math (rough):

  • 8× H200 rental: ~$40/hour × 720h = $28.8K/month.
  • Equivalent API cost at $3/$15: with 30/70 input/output mix, average $11.40 / MTok. $28.8K buys 2.53 billion tokens/month = 84M tokens/day.
  • Break-even: ~85-100M tokens/day steady. Above that, self-hosting wins; below that, the API wins.

Add fine-tuning, data residency, or predictable latency as multipliers that make self-hosting attractive at lower volumes.

Tool Integration Status (July 18, 2026)

Already working with K3 via API:

  • Cursor (add as custom model, OpenAI-compatible endpoint).
  • Continue.dev (add via config.yaml).
  • Cline / Roo Code (custom OpenAI-compatible provider).
  • Aider (--model kimi/k3).
  • Kimi Code — Moonshot’s own Claude-Code-style CLI, native.

Expected within days of July 27:

  • vLLM native support.
  • SGLang native support.
  • Ollama community quantizations.
  • LM Studio community quantizations (MXFP4).
  • Together, Fireworks, DeepInfra hosted endpoints.

The Modified MIT License Question

Kimi K3 ships under a Modified MIT license — meaning some conditions attach vs pure MIT. Watch for these clauses in the actual license text (release July 27):

  • Prohibited uses (military, some critical infrastructure, or specific downstream products).
  • Attribution requirements (must credit Moonshot for downstream products above a size threshold).
  • Redistribution restrictions (some frontier open-weight licenses require notifying the vendor for large redistributions).

Most enterprise use will be fine, but review the license before shipping a commercial product built on K3.

Sub-Questions Buyers Are Asking

Is K3 actually good enough to displace Claude Sonnet 5 for coding? Not yet on independent benchmarks. Moonshot’s numbers are internal. Wait for artificialanalysis.ai and Kilo/BenchLM independent scores over the next 7-10 days. For coding today, Claude Sonnet 5 and GPT-5.6 Sol remain the highest-confidence picks.

Can I use K3 in China-restricted contexts (US federal, EU financial)? K3 is a Chinese model — most US federal contracts and some EU regulated financial contexts will not approve it, regardless of open weights. Self-hosting on your own EU/US infra addresses data residency but not model-provenance policies.

Is Kimi K3 open enough to fine-tune? Yes, once weights land. Community LoRA and full fine-tuning pipelines will appear within a week. For MoE fine-tuning at this scale, use torchtune, unsloth (once K3 support lands), or MegaBlocks. Expect $50-200K in compute for a serious full fine-tune.

How does K3 compare to DeepSeek V4 Pro on cost? DeepSeek V4 Pro is roughly 7× cheaper on API ($0.44/$0.87 vs $3.00/$15.00). If your task doesn’t need K3’s frontier capability, V4 Pro is a stronger open-weight budget pick. Use K3 when you need Fable-5-adjacent performance at 30% of Fable 5’s price.

Bottom Line

Kimi K3 is the first open-weight model where “self-host for real” becomes an obvious CTO conversation, not a hobbyist debate. With frontier-adjacent quality, 1M context, native vision, and a real MIT-family license coming July 27, K3 changes the math for teams doing more than 100M tokens/day of steady traffic.

For most teams: use the API today ($3/$15). Wait for independent benchmarks before making K3 your default coding model. Plan self-hosted capacity for July 30 onward if data residency, fine-tuning, or high steady volume applies. And keep DeepSeek V4 Pro and MiniMax M3 in the mix — the Chinese open-weight ecosystem is now genuinely competitive top to bottom.

Sources