F

firecrawl-agent

by @firecrawlv
4.7(108)

AI-driven autonomous data extraction tool capable of navigating complex websites and returning structured JSON data.

ai-agentsfirecrawl-apiautonomous-data-collectionweb-automationllm-toolingGitHub
Installation
npx skills add firecrawl/cli --skill firecrawl-agent
compare_arrows

Before / After Comparison

1
Before

In the past, extracting structured data from complex websites typically required writing customized web scraper scripts, dealing with anti-scraping mechanisms, dynamic content, and varying page layouts. This was time-consuming, had high maintenance costs, and was prone to failure.

After

Firecrawl Agent, as an AI-driven autonomous data extraction tool, can intelligently navigate complex websites, automatically handle various challenges, and return high-quality structured JSON data, significantly boosting data acquisition efficiency.

SKILL.md

firecrawl agent

AI-powered autonomous extraction. The agent navigates sites and extracts structured data (takes 2-5 minutes).

When to use

  • You need structured data from complex multi-page sites
  • Manual scraping would require navigating many pages
  • You want the AI to figure out where the data lives

Quick start

# Extract structured data
firecrawl agent "extract all pricing tiers" --wait -o .firecrawl/pricing.json

# With a JSON schema for structured output
firecrawl agent "extract products" --schema '{"type":"object","properties":{"name":{"type":"string"},"price":{"type":"number"}}}' --wait -o .firecrawl/products.json

# Focus on specific pages
firecrawl agent "get feature list" --urls "<url>" --wait -o .firecrawl/features.json

Options

OptionDescription
--urls <urls>Starting URLs for the agent
--model <model>Model to use: spark-1-mini or spark-1-pro
--schema <json>JSON schema for structured output
--schema-file <path>Path to JSON schema file
--max-credits <n>Credit limit for this agent run
--waitWait for agent to complete
--prettyPretty print JSON output
-o, --output <path>Output file path

Tips

  • Always use --wait to get results inline. Without it, returns a job ID.
  • Use --schema for predictable, structured output — otherwise the agent returns freeform data.
  • Agent runs consume more credits than simple scrapes. Use --max-credits to cap spending.
  • For simple single-page extraction, prefer scrape — it's faster and cheaper.

See also

User Reviews (0)

Write a Review

Effect
Usability
Docs
Compatibility

No reviews yet

Statistics

Installs43.5K
Rating4.7 / 5.0
Version
Updated2026年5月23日
Comparisons1

User Rating

4.7(108)
5
23%
4
52%
3
23%
2
2%
1
0%

Rate this Skill

0.0

Compatible Platforms

🔧Claude Code
🔧OpenClaw
🔧OpenCode
🔧Codex
🔧Gemini CLI
🔧GitHub Copilot
🔧Amp
🔧Kimi CLI

Timeline

Created2026年3月16日
Last Updated2026年5月23日