# URL to Markdown converter and API

Give it a list of web addresses and get each page back as clean Markdown, with its title and metadata, ready for a search index, a chatbot or a prompt.

**From USD 1.00 per 1,000 converted pages.** On the Apify Store since 13 November 2026. Checked 14 November 2026. Apify Store page: https://apify.com/tan-solutions/url-to-markdown

## What it does

URL to Markdown reads each page you list and keeps what a reader needs: headings, paragraphs, lists, tables, code blocks, links and images. Menus, footers and cookie banners are dropped. The result is plain Markdown text that large language models (LLMs) read well and that is easy to store, search and compare.

It reads plain HTML first, which is fast and cheap. Only when a page turns out to be an empty JavaScript shell does it open the page again in a real browser. You pay only for pages that convert.

- **Whole pages or main text.** The default, "Full page", keeps the page body. "Article" keeps only the main text, which is smaller.
- **Metadata for every page.** Title, description, language, site name, published and modified time, canonical URL and image.
- **Chunks for RAG.** Set a chunk size and the Markdown is split at headings and paragraphs, so no chunk cuts a sentence or a code block in half.
- **Optional front matter.** A YAML block at the top of each page with title, URL, description, language and date.
- **Other text formats.** JSON, XML and plain-text URLs come back as fenced blocks or plain text instead of failing.
- **A clear status per URL.** Every URL gets a status and, if it failed, an error code, so you know exactly what happened.

## Who it is for

- Developers who build retrieval-augmented generation (RAG) search, chatbots or knowledge bases from websites and documentation.
- AI agents and MCP clients that need to read a web page as text.
- Anyone who wants a page saved as Markdown for notes, prompts, archives or comparing versions.

## What it costs

**From USD 1.00 per 1,000 converted pages.** You pay per result. The price depends on your Apify plan:

| Apify plan tier | Price per 1,000 converted pages |
|---|---|
| FREE | USD 1.50 |
| BRONZE | USD 1.20 |
| SILVER | USD 1.10 |
| GOLD | USD 1.00 |

Free, never charged: pages that fail or time out; pages a bot wall or CAPTCHA blocks; pages robots.txt does not allow; URLs over your "Max URLs" cap; pages too big for the run memory. Apify also charges a small start event per run.

## Input

The fields you will most likely change:

| Field | What it does | Default |
|---|---|---|
| `startUrls (URLs)` | The pages to convert. | https://example.com |
| `maxUrls (Max URLs)` | Stop after this many URLs, from 1 to 1,000. The rest are listed as skipped and are free. | 100 |
| `extractMode` | "full" keeps the whole page body; "article" keeps the main text only. | full |
| `renderMode` | "auto" opens a browser only when needed; "http" never; "browser" for every page. | auto |
| `includeLinks, includeImages` | Keep links and images in the Markdown. | on, on |
| `frontMatter` | Add YAML front matter to each page. | off |
| `chunkSize` | Split into chunks of about this many characters (500 to 100,000; 0 means no chunks). | 0 |
| `timeoutSecs` | Time limit per page, 5 to 120 seconds. | 30 |
| `maxConcurrency` | Pages converted at the same time, 1 to 20. | 5 |

A small input to start from:

```json
{
  "startUrls": [
    {
      "url": "https://docs.python.org/3/tutorial/introduction.html"
    }
  ],
  "chunkSize": 2000
}
```

## Output

One result per URL, in the order you gave them. This is a real result from a test run on 13 November 2026, with the Markdown cut short:

```json
{
  "url": "https://go.dev/doc/tutorial/getting-started",
  "status": "ok",
  "title": "Tutorial: Get started with Go - The Go Programming Language",
  "markdown": "# Tutorial: Get started with Go\n\nIn this tutorial, you'll get a brief introduction to Go programming. ...",
  "wordCount": 1041,
  "chunks": null,
  "metadata": {
    "lang": "en",
    "canonicalUrl": "https://go.dev/doc/tutorial/getting-started"
  },
  "fetchedWith": "http",
  "httpStatus": 200,
  "crawledAt": "2026-11-13T07:49:36.789Z",
  "error": null
}
```

The status is "ok", "robots_disallowed", "blocked" or "error". With a chunk size set, "chunks" is a list of Markdown strings. A failed result carries an error code such as TIMEOUT, HTTP_ERROR or EMPTY_CONTENT and a plain message. Download as JSON, CSV or Excel, or read them through the API.

## How to run it

### In Apify Console, no code

1. Paste one or more web addresses into "URLs".
2. Click Start.
3. Open the Output tab and download the results as JSON, CSV or Excel, or read them through the API.

Start from the tool's page (https://apify.com/tan-solutions/url-to-markdown). You need an Apify account.

### From the API

One call runs the tool and returns the results. Replace `<YOUR_API_TOKEN>` with your token from Apify Console (Settings, API and Integrations). Send `{}` for a short demo run.

```bash
curl -X POST "https://api.apify.com/v2/acts/tan-solutions~url-to-markdown/run-sync-get-dataset-items?token=<YOUR_API_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"startUrls":[{"url":"https://docs.python.org/3/tutorial/introduction.html"}],"chunkSize":2000}'
```

### From an AI agent, through MCP

Apify's MCP server offers this tool alone to your MCP client at `https://mcp.apify.com?tools=tan-solutions/url-to-markdown`. The client signs in to Apify on first connect, or sends your token in an `Authorization: Bearer` header.

```json
{
  "mcpServers": {
    "apify": {
      "url": "https://mcp.apify.com?tools=tan-solutions/url-to-markdown"
    }
  }
}
```

## Run it on a schedule

Convert the same pages again every day, so your search index or knowledge base always has the current text. In Apify Console: Schedules, Create new, cron `0 6 * * *` (every day at 06:00 UTC), then add this tool with your input. Or as one API call (`Qxw1MitrgVkJQisiY` is this tool's Actor ID):

```bash
curl -X POST "https://api.apify.com/v2/schedules?token=<YOUR_API_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{
  "name": "url-to-markdown-schedule",
  "cronExpression": "0 6 * * *",
  "timezone": "UTC",
  "isEnabled": true,
  "isExclusive": true,
  "actions": [
    {
      "type": "RUN_ACTOR",
      "actorId": "Qxw1MitrgVkJQisiY",
      "runInput": {
        "body": "{\"startUrls\":[{\"url\":\"https://docs.python.org/3/tutorial/introduction.html\"}],\"chunkSize\":2000}",
        "contentType": "application/json"
      }
    }
  ]
}'
```

## Limits

- robots.txt is respected. Pages it does not allow come back as "robots_disallowed" and are free.
- Public pages only: no logins, cookies, forms or paywalls.
- It stops at CAPTCHAs and bot walls and reports them as "blocked" (free). It does not solve CAPTCHAs or hide who it is.
- Up to 1,000 URLs per run. One result holds at most 5 million characters of Markdown.
- Run memory is 4 GB by default and 2 GB at least.
- The crawler identifies itself as TanForgeBot. Site owners can allow or block it in robots.txt with that name.

## Questions

### Does it work on JavaScript pages?

Yes. In auto mode, a page whose HTML has almost no text and looks like a single-page app is opened again in a real browser. Choose "browser" to render every page.

### Can it convert PDF or Word files?

Use PDF, Word and PowerPoint to Markdown for documents. URL to Markdown converts web pages, plus JSON, XML and plain text.

### How fast is it?

It converts 5 pages at the same time by default, up to 20, and paces its requests to each site. A typical page takes about 3 seconds.

### Where are my results kept?

In the run's dataset in your own Apify account, for as long as your Apify plan keeps data. Tan Solutions keeps no copy.

Not affiliated with OpenAI, Anthropic, LangChain or LlamaIndex. All product names belong to their owners. Built and run by Tan Solutions.

Source: https://www.tansolutions.org/tools/url-to-markdown/ · Tan Solutions
