firecrawl-download
Downloads entire websites as local files, supporting Markdown and screenshot formats, for offline viewing, analysis, and content archiving.
npx skills add firecrawl/cli --skill firecrawl-downloadBefore / After Comparison
1 组Before Firecrawl Download, downloading an entire website's content typically involved manually saving pages one by one or using simple download tools. However, this often led to broken links, inconsistent formatting, and the inability to preserve the website's original structure. This made offline viewing or backup extremely time-consuming and incomplete.
With Firecrawl Download, you can download an entire website as local files with a single click. It supports various formats like Markdown and screenshots, and preserves the website's original structure. This significantly improves the efficiency and quality of content acquisition, facilitating offline use and document archiving.
firecrawl download
Experimental. Convenience command that combines
map+scrapeto save an entire site as local files.
Maps the site first to discover pages, then scrapes each one into nested directories under .firecrawl/. All scrape options work with download. Always pass -y to skip the confirmation prompt.
When to use
- You want to save an entire site (or section) to local files
- You need offline access to documentation or content
- Bulk content extraction with organized file structure
Quick start
# Interactive wizard (picks format, screenshots, paths for you)
firecrawl download https://docs.example.com
# With screenshots
firecrawl download https://docs.example.com --screenshot --limit 20 -y
# Multiple formats (each saved as its own file per page)
firecrawl download https://docs.example.com --format markdown,links --screenshot --limit 20 -y
# Creates per page: index.md + links.txt + screenshot.png
# Filter to specific sections
firecrawl download https://docs.example.com --include-paths "/features,/sdks"
# Skip translations
firecrawl download https://docs.example.com --exclude-paths "/zh,/ja,/fr,/es,/pt-BR"
# Full combo
firecrawl download https://docs.example.com \
--include-paths "/features,/sdks" \
--exclude-paths "/zh,/ja" \
--only-main-content \
--screenshot \
-y
Download options
| Option | Description |
|---|---|
--limit <n> | Max pages to download |
--search <query> | Filter URLs by search query |
--include-paths <paths> | Only download matching paths |
--exclude-paths <paths> | Skip matching paths |
--allow-subdomains | Include subdomain pages |
-y | Skip confirmation prompt (always use in automated flows) |
Scrape options (all work with download)
-f <formats>, -H, -S, --screenshot, --full-page-screenshot, --only-main-content, --include-tags, --exclude-tags, --wait-for, --max-age, --country, --languages
See also
- firecrawl-map — just discover URLs without downloading
- firecrawl-scrape — scrape individual pages
- firecrawl-crawl — bulk extract as JSON (not local files)
User Reviews (0)
Write a Review
No reviews yet
Statistics
User Rating
Rate this Skill