firecrawl-build-crawl
Performs large-scale crawling of documentation sites, blogs, and help centers, supporting batch data extraction with custom path boundaries and depth control.
npx skills add https://github.com/firecrawl/skills --skill firecrawl-build-crawlBefore / After Comparison
1 组Manually visit target website pages one by one, copy and paste content to local files, making it difficult to control crawling depth and path scope. A 100-page document site takes 2 hours to complete collection.
Automatically batch crawl after configuring domain and path rules, intelligently identify site structure and extract content according to depth boundaries, completing batch download and structured storage of the entire site segment in 5 minutes.
firecrawl-build-crawl
Firecrawl Build Crawl
Use this when the product needs many pages from the same site, not just one.
Use This When
-
the feature targets a docs section, blog, or help center
-
you need bulk extraction with path or depth boundaries
-
the product should ingest or refresh a site section at once
Guidance
-
Keep crawl scope narrow with path, depth, or page-count constraints.
-
Prefer
/crawlover many manual/scrapecalls when the site structure is stable. -
Treat this as secondary to
/scrape,/search, and/interactunless the feature is clearly site-wide.
When Not To Use It
-
If you only need one known URL, use firecrawl-build-scrape.
-
If you first need to discover URLs on a single site, start with firecrawl-build-map.
Docs (Source of Truth)
Read the docs for request/response schemas, parameters, and SDK examples before writing integration code:
See Also
Weekly Installs554Repositoryfirecrawl/skillsGitHub Stars2First Seen5 days agoSecurity AuditsGen Agent Trust HubPassSocketPassSnykWarnInstalled onopencode550antigravity550github-copilot550codex550amp550cline550
User Reviews (0)
Write a Review
No reviews yet
Statistics
User Rating
Rate this Skill