---
id: daily-firecrawl-build-crawl
name: "firecrawl-build-crawl"
url: https://skills.yangsir.net/skill/daily-firecrawl-build-crawl
author: firecrawl
domain: ai-data-management-analysis
tags: ["data-extraction", "web-scraping", "automation"]
install_count: 554
rating: 4.20 (10 reviews)
github: https://github.com/firecrawl/skills
---

# firecrawl-build-crawl

> 针对文档站点、博客和帮助中心进行大规模爬取，支持自定义路径边界和深度控制的批量数据提取

**Stats**: 554 installs · 4.2/5 (10 reviews)

## Before / After 对比

### 站点批量爬取

**Before**:

手动逐个访问目标网站页面，复制粘贴内容到本地文件，难以控制爬取深度和路径范围，一个100页的文档站点需要2小时完成收集

**After**:

配置域名和路径规则后自动批量爬取，智能识别站点结构并按深度边界提取内容，5分钟完成整个站点段的批量下载和结构化存储

| Metric | Before | After | Change |
|---|---|---|---|
| 爬取时间 | 120分钟 | 5分钟 | -96% |

## Readme

# firecrawl-build-crawl

# Firecrawl Build Crawl

Use this when the product needs many pages from the same site, not just one.

## Use This When

- the feature targets a docs section, blog, or help center

- you need bulk extraction with path or depth boundaries

- the product should ingest or refresh a site section at once

## Guidance

- Keep crawl scope narrow with path, depth, or page-count constraints.

- Prefer `/crawl` over many manual `/scrape` calls when the site structure is stable.

- Treat this as secondary to `/scrape`, `/search`, and `/interact` unless the feature is clearly site-wide.

## When Not To Use It

- If you only need one known URL, use [firecrawl-build-scrape](https://github.com/firecrawl/skills/blob/HEAD/skills/firecrawl-build-crawl/../firecrawl-build-scrape/SKILL.md).

- If you first need to discover URLs on a single site, start with [firecrawl-build-map](https://github.com/firecrawl/skills/blob/HEAD/skills/firecrawl-build-crawl/../firecrawl-build-map/SKILL.md).

## Docs (Source of Truth)

Read the docs for request/response schemas, parameters, and SDK examples before writing integration code:

- [docs.firecrawl.dev/features/crawl](https://docs.firecrawl.dev/features/crawl)

## See Also

- [firecrawl-build](https://github.com/firecrawl/skills/blob/HEAD/skills/firecrawl-build-crawl/../firecrawl-build/SKILL.md)

- [firecrawl-build-map](https://github.com/firecrawl/skills/blob/HEAD/skills/firecrawl-build-crawl/../firecrawl-build-map/SKILL.md)

- [firecrawl-build-scrape](https://github.com/firecrawl/skills/blob/HEAD/skills/firecrawl-build-crawl/../firecrawl-build-scrape/SKILL.md)

Weekly Installs554Repository[firecrawl/skills](https://github.com/firecrawl/skills)GitHub Stars2First Seen5 days agoSecurity Audits[Gen Agent Trust HubPass](/firecrawl/skills/firecrawl-build-crawl/security/agent-trust-hub)[SocketPass](/firecrawl/skills/firecrawl-build-crawl/security/socket)[SnykWarn](/firecrawl/skills/firecrawl-build-crawl/security/snyk)Installed onopencode550antigravity550github-copilot550codex550amp550cline550

---
*Source: https://skills.yangsir.net/skill/daily-firecrawl-build-crawl*
*Markdown mirror: https://skills.yangsir.net/api/skill/daily-firecrawl-build-crawl/markdown*