AI agents · OpenClaw · self-hosting · automation

Quick Answer

GPT-6 Astra Long-Context Pricing: The 272K Cliff

Published:

The Short Answer

GPT-6 Astra advertises a 1,050,000-token context window. Prompts above roughly 272,000 tokens are billed at a premium.

  • Below 272K: $10 per million input tokens, $50 per million output.
  • Above 272K: input at approximately 2x, pushing effective rates to around $20 per million input.

Filling the window costs $10 or more per call at standard rates, and roughly double that once the premium applies. Last verified: September 4, 2026.

The Pricing Structure

Standard (≤272K)Long context (>272K)
Input / MTok$10.00~$20.00
Output / MTok$50.00premium applies
Cached input / MTok$1.00
Cache write / MTok~$12.50
Batch / flex50% of standard

One honest caveat. Reporting on the output multiplier is inconsistent — some outlets describe roughly 1.5x output (about $75 per million), others describe a straight doubling (about $100 per million). The input doubling is consistently reported. Until OpenAI’s pricing page is unambiguous on this point, budget at the higher figure and verify against your first month’s actual billing. This page will be updated when the discrepancy resolves.

Why the Cliff Exists

Attention cost scales worse than linearly with sequence length, and very long contexts require different serving infrastructure — more memory per request, fewer concurrent requests per GPU, worse batching efficiency. Providers increasingly price this reality rather than absorb it.

This is not unique to OpenAI. Grok 4.6 reprices the entire request once a prompt crosses 200K tokens. Anthropic applies cache-write multipliers of 1.25x for five-minute TTL and 2x for one-hour. The industry direction is clear: advertised context windows are capability ceilings, not pricing tiers.

The practical consequence is that “1M context” on a spec sheet and “1M context you can afford to use” are different products.

What It Actually Costs

Concrete arithmetic at standard rates:

Prompt sizeInput cost (standard)Input cost (>272K premium)
50,000 tokens$0.50
200,000 tokens$2.00
272,000 tokens$2.72
500,000 tokens~$10.00
1,000,000 tokens~$20.00

Now multiply by turns. An agent that carries a 500K-token context across a twenty-turn session and refills it each turn is spending around $200 on input alone, before a single output token. This is the single most common cause of unexplained API bill spikes in long-context workloads.

Four Ways to Stay Under the Threshold

1. Retrieval instead of stuffing. Send only the chunks relevant to the current step. A well-tuned retrieval layer typically reduces context by 10–50x with no quality loss, because most of a large document is irrelevant to any single question. This is the highest-leverage fix and it also improves accuracy — models attend better to less noise.

2. Prompt caching. GPT-6 Astra cached input costs $1 per million against $10 standard — a 90% reduction on re-read tokens. Cache writes run around $12.50 per million, so caching pays off when a stable context is read at least twice. Structure prompts so the stable portion comes first and the variable portion last, which is what makes the cache prefix reusable.

For comparison, Claude Fable 5.1 cache reads are $0.25 per million and Muse Spark 1.3 is near $0.15. If your workload is fundamentally context-heavy, the cache-read price is a legitimate reason to choose a different model.

3. Compaction. Summarise old conversation turns rather than carrying them verbatim. Most long agent sessions accumulate context that is no longer decision-relevant — tool outputs already acted on, exploratory branches already abandoned. Compaction is what ARC Prize’s Provider Adapter harness does, and it made GPT-6 Astra both better and cheaper on hard multi-turn tasks.

4. Batch and flex processing at 50%. Anything that does not need synchronous latency — nightly analysis, bulk document processing, evaluation runs — should not pay standard rates. This halves the bill without touching architecture.

When a Big Window Is Actually the Right Answer

Long context is an escape hatch, not a default. It genuinely wins when:

  • The context is irreducible. A single large codebase, contract or dataset where chunking destroys the relationships you need to reason over.
  • Retrieval keeps failing. If your retrieval layer misses the relevant chunk more than occasionally, the failure cost may exceed the token cost.
  • The reasoning is global. Questions like “is this consistent throughout” or “what changed across these versions” cannot be answered from chunks.

In those cases, check retrieval quality at length, not just window size. Meta reports Muse Spark 1.3 at 98.5% on MRCR 256K–512K and 98.1% on 512K–1M, essentially flat. GPT-5.6 Sol drops from 91.5% to 73.8% across the same bands. A model that degrades at length gives you an expensive window you cannot trust — you pay premium rates for answers drawn from context the model is effectively ignoring.

A Checklist Before You Ship Long Context

  • Measure your actual p95 prompt size in production, not your worst case. Most workloads sit far below the threshold and do not need any of this.
  • Instrument tokens per request and alert when the threshold is crossed, so the first time you learn about it is not the invoice.
  • Verify the output multiplier against your own billing during the first week.
  • Structure prompts cache-first — stable prefix, variable suffix.
  • Set a hard context budget in code that triggers compaction or retrieval rather than silently growing.
  • Compare cache-read prices across models if you are context-heavy; this may matter more than the headline rate.
  • Route long-context work to batch tier wherever latency permits.

The Takeaway

The 272K threshold is not a reason to avoid GPT-6 Astra — its token efficiency makes it cheaper per completed task than nominally cheaper models on hard work. It is a reason to design for the threshold rather than discover it.

The general 2026 principle: advertised context windows describe what a model can accept, and pricing tiers describe what you can afford to send. Treat those as separate numbers, measure your real prompt sizes, and reach for retrieval and caching before reaching for the window.

Sources