Pricing Dashboard Sign up
Recent
· 7 min read · MDisBetter

How to Reduce ChatGPT Token Usage on Documents

If you're paying for ChatGPT API access on document-heavy workloads, you're probably overpaying. Most teams running document workflows through GPT-4o or GPT-5 are sending more tokens per document than they need to: pure waste, billable on every call. The fix is one preprocessing step that strips most of that waste before it reaches the model.

Where your tokens actually go

Take the text a PDF parser extracts from a typical report and break it down by category:

Only the first category is what you meant to send. The share of the others varies from one document to the next.

You're paying full token price for all of it. ChatGPT will do its best to ignore the noise during reasoning, but two things go wrong: the input cost is real (you pay regardless of whether the model uses it), and the noise actively distracts attention from the content during long-context retrieval.

Measure it on your own documents

The size of the saving depends on your documents, so measure it rather than assume it. Pick a handful of documents you actually send to ChatGPT, covering the types you handle (reports, contracts, manuals, slide exports, scans). For each one, count tokens on the text you send today and on the Markdown version, with the same tokenizer.

Reduction = (current tokens - Markdown tokens) / current tokens. Look at the range as well as the average: documents with the most layout noise, such as scans, multi-column layouts and slide exports, are where conversion has the most to remove.

The dollar math at scale

GPT-4o pricing as of mid-2026: $2.50 per million input tokens. Monthly input cost = conversations per month × input tokens per conversation × price per token. For example, a team running 1,000 document conversations per month at 60,000 input tokens per conversation sends 60 million tokens, or $150/month in input.

Run the same formula with the token count of the Markdown version of those documents: the difference is your saving, on the same model, for the same questions. The savings scale linearly with usage, so for agency or consultancy workflows running tens of thousands of conversations, a modest per-document reduction becomes a large monthly amount. And there's little trade-off, because Markdown input also tends to produce better answers.

How to actually do it (30 seconds)

For interactive use:

  1. Drop your PDF into our PDF to Markdown converter
  2. Copy or download the Markdown
  3. Use that as your ChatGPT input

For programmatic use (RAG pipelines, ingestion jobs, or anything where a human isn't going to drag-and-drop each PDF), MDisBetter doesn't currently ship a public API. The realistic path is an OSS converter (Marker, Docling, or PyMuPDF) running locally as a Python step before your OpenAI/Anthropic call. The token reduction comes from the format, so it shows up whichever Markdown converter you use: same documents in, fewer tokens out. Measure the output to see how much.

To verify your savings, paste both the PDF-extracted text and the Markdown into our token counter. The numbers are concrete; the difference is what you stop paying.

Beyond PDFs: other formats that waste tokens

The same logic applies to other source formats. PowerPoint slides exported as PDF, Word documents pasted directly into chat, Excel exports: all carry layout overhead that tokenizes wastefully. Converting them to Markdown first removes that overhead too.

For comprehensive token savings across all your document workflows, see our companion piece on choosing input formats for LLMs.

Frequently asked questions

Does the reduction hold on Claude or Gemini?
Yes: the savings come from removing layout noise, which is model-agnostic. Each model has its own tokenizer and its own document extraction, so the exact figure differs; measure with the tokenizer of the model you use.
Is the conversion itself expensive?
Our web tool runs on a free account; each conversion uses credits, and paid plans add more volume. OSS converters (Marker, Docling, PyMuPDF) are free software; you pay for the compute you run them on. Either way, compare the one-time conversion cost with the input tokens you save on every conversation that reuses the document.
What if my PDFs are short: does this still pay off?
On documents under 5 pages, the absolute savings are smaller but the proportional savings are similar. The setup cost is zero (it's just a preprocessing step), so even small documents are worth converting if you're already in the workflow.