What's the difference between URL to Text and URL to Markdown?

URL to Text gives you flat UTF-8 — no structural markers, no headings, no list bullets. URL to Markdown preserves the page's heading hierarchy, lists, tables, and code blocks. Use Text for plain-text scripts, search indexing, or NLP pipelines that don't care about structure; use Markdown when structure matters (AI input, wikis, docs sites).

Does this handle JavaScript-heavy single-page apps?

Yes — pages render in a headless browser before extraction, so SPAs (React, Vue, Svelte sites) load their actual content first. A naive curl URL would return the empty shell; we wait for hydration and read the rendered DOM.

Are nav menus, cookie banners, and ads removed?

Yes — readability extraction detects the main content area and discards site furniture (nav, side rails, footer, cookie consent, newsletter pop-ups, related-posts widgets, comment threads). What's left is the article body. If you want the full page including chrome (rare), use the API with the main_content_only=false flag.

Can I extract text from a list of URLs in batch?

Yes — POST a JSON array of URLs to the API and get a ZIP of one text file per URL back. Typical throughput is 1-3 URLs/second per worker; for big batches (1000+ URLs) the API runs them on a worker pool and emails you when the ZIP is ready.

Does it respect robots.txt and rate limits?

Single-page conversion ignores robots.txt (you're fetching one page you already know about). Multi-page crawls respect robots.txt by default and rate-limit at one request per second per host out of the box. Both behaviours are configurable on the API; default to polite.

URL to Text — Free Online Web Page Text Extractor

How "URL to Text" actually works here

Every URL goes through a headless browser so JavaScript-rendered content actually loads, then through a Mozilla-Readability-style extraction pass that identifies the main content area, then through a final flattening step that strips Markdown markers (no #, no *, no list bullets — just the words). The result is plain text — copy-paste-ready, search-indexable, ready for any tool that wants UTF-8 string input.

Single page, full crawls, both

Paste one URL for a single-page extraction. Paste a sitemap URL or root domain for a multi-page crawl that returns one text file per page (zipped). Same content extraction either way; the crawl mode just batches it across the site and respects robots.txt by default.

URL to Text — Extract Clean Text from Any Webpage

How "URL to Text" actually works here

Single page, full crawls, both

Frequently asked questions

Stop feeding garbage
to your AI

Tools

Stop feeding garbageto your AI

Tools

Stop feeding garbage
to your AI