F

firecrawl-map

by @firecrawlv
4.7(108)

Automatically scrapes and lists all URLs on a website, supporting optional deep search, helping users fully understand website structure and content distribution.

data-mappingweb-structure-analysisfirecrawl-apiinformation-architecturecontent-organizationGitHub
Installation
npx skills add firecrawl/cli --skill firecrawl-map
compare_arrows

Before / After Comparison

1
Before

Traditionally, discovering all URLs on a website typically required manual clicking or using simple crawling tools, which was inefficient and struggled to handle large websites or dynamically generated links, often missing important pages.

After

Firecrawl Map efficiently discovers and lists all URLs on a website, supporting optional deep scanning, providing a comprehensive website structure view, and greatly simplifying website analysis and content auditing.

SKILL.md

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs on a site before scraping or crawling
  • Step 3 in the workflow escalation pattern: search → scrape → map → crawl → browser

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Options

OptionDescription
--limit <n>Max number of URLs to return
--search <query>Filter URLs by search query
--sitemap <include|skip|only>Sitemap handling strategy
--include-subdomainsInclude subdomain URLs
--jsonOutput as JSON
-o, --output <path>Output file path

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authenticationscrape that URL.

See also

User Reviews (0)

Write a Review

Effect
Usability
Docs
Compatibility

No reviews yet

Statistics

Installs43.3K
Rating4.7 / 5.0
Version
Updated2026年5月23日
Comparisons1

User Rating

4.7(108)
5
23%
4
52%
3
23%
2
2%
1
0%

Rate this Skill

0.0

Compatible Platforms

🔧Claude Code
🔧OpenClaw
🔧OpenCode
🔧Codex
🔧Gemini CLI
🔧GitHub Copilot
🔧Amp
🔧Kimi CLI

Timeline

Created2026年3月16日
Last Updated2026年5月23日