Use case 06 · Scrape website to Markdown
Scrape a website to Markdown.
Website content to Markdown means the articles, not the theme. output.md fetches public pages, drops the menus and ads, and gives you one .md file per page.
Free account, 10 markdown + 10 AI credits included. No credit card needed.
Today
- A scraper script that breaks the next time the site changes its CSS.
- Saved HTML full of navigation, cookie bars and related posts.
- Copy-paste from a dozen tabs into one notes file.
With output.md
- The main content of each page as Markdown.
- Headings, lists, tables and links kept. Images and scripts removed.
- A ZIP you can put in a repo, a notes app or a language-model pipeline.
Step by step
How it works, in 4 steps.
-
01
Start from the sitemap, or from a list
You do
If the site publishes sitemap.xml, paste that. If it does not, paste the URLs in bulk mode, one per line. There is no crawler that discovers every link on its own.
You get
A queue you can edit before anything is fetched.
-
02
Keep the pages that have the content
You do
Drop homepages full of modules, tag archives and URLs that only redirect.
You get
The pages whose text you actually want.
-
03
Scrape to Markdown
You do
Process the queue. Each URL is fetched server-side and reduced to the article. One markdown credit per page.
You get
Website content as Markdown files, with the source URL stored on each item.
TipJavaScript-rendered text usually comes through. Login walls do not.
-
04
Export
You do
Check a sample in the editor, then download the ZIP.
You get
One .md file per page you chose.
Why it works
What you get out of it.
Content, not chrome
The file is the article a person came to read. Navigation and cookie banners stay on the site.
You choose the scope
A sitemap or a pasted list. You are not hoping a crawler guessed the right pages.
Plain files out
Markdown you can commit, archive or feed to a model. No project lock-in on the export.
What it costs
1 markdown credit per page.
A free account includes 10 markdown credits. Review the queue first so you only pay for pages you keep.
Packs are one-time top-ups — no subscription. See all packs.
Questions
Before you start.
How do I scrape a website to Markdown?
Paste the sitemap or a list of URLs, remove what you do not want, process the queue, and export the .md files. output.md reads public pages. It does not log in, and it does not crawl the web looking for links.
How do I turn website content into Markdown?
Same path. The conversion keeps the article: headings, lists, tables and links. Menus, ads, images and scripts are removed. One page on its own is the HTML to Markdown use case.
Will it scrape pages behind a login?
No. The URL has to be publicly reachable. For a private doc, export it and upload the PDF or Word file.
Can I republish what I scrape?
You get a copy of publicly available text for your own use. Respect the site’s terms. Do not republish their content as your own.
How is this different from converting one HTML page?
HTML to Markdown is one URL. This is the site: a sitemap or a list, then a ZIP of files. Sitemap to Markdown is the same engine when you already have sitemap.xml and that is the whole question.
Try it on your own material.
Paste a link or upload a file, and see the Markdown before you decide anything else.