首页/数据 & AI/tavily-map
T

tavily-map

by @tavily-aiv
4.5(44)

快速发现网站上的所有URL链接,但不提取页面内容,比传统爬取更高效,适用于网站结构分析和链接资源探索。

url-discoverywebsite-mappinginformation-retrievalweb-explorationsite-analysisGitHub
安装方式
npx skills add tavily-ai/skills --skill tavily-map
compare_arrows

Before / After 效果对比

1
使用前

过去要获取一个网站的所有URL,需要手动点击或编写复杂的爬虫脚本,过程缓慢且容易遗漏重要链接。

使用后

Tavily Map技能能快速发现网站上的所有URL,且不提取内容,极大提升网站结构分析和链接发现的效率。

SKILL.md

tavily-map

tavily map

Discover URLs on a website without extracting content. Faster than crawling.

Before running any command

If tvly is not found on PATH, install it first:

curl -fsSL https://cli.tavily.com/install.sh | bash && tvly login

Do not skip this step or fall back to other tools.

See tavily-cli for alternative install methods and auth options.

When to use

  • You need to find a specific subpage on a large site

  • You want a list of all URLs before deciding what to extract or crawl

  • Step 3 in the workflow: search → extract → map → crawl → research

Quick start

# Discover all URLs
tvly map "https://docs.example.com" --json

# With natural language filtering
tvly map "https://docs.example.com" --instructions "Find API docs and guides" --json

# Filter by path
tvly map "https://example.com" --select-paths "/blog/.*" --limit 500 --json

# Deep map
tvly map "https://example.com" --max-depth 3 --limit 200 --json

Options

Option Description

--max-depth Levels deep (1-5, default: 1)

--max-breadth Links per page (default: 20)

--limit Max URLs to discover (default: 50)

--instructions Natural language guidance for URL filtering

--select-paths Comma-separated regex patterns to include

--exclude-paths Comma-separated regex patterns to exclude

--select-domains Comma-separated regex for domains to include

--exclude-domains Comma-separated regex for domains to exclude

--allow-external / --no-external Include external links

--timeout Max wait (10-150 seconds)

-o, --output Save output to file

--json Structured JSON output

Map + Extract pattern

Use map to find the right page, then extract it. This is often more efficient than crawling an entire site:

# Step 1: Find the authentication docs
tvly map "https://docs.example.com" --instructions "authentication" --json

# Step 2: Extract the specific page you found
tvly extract "https://docs.example.com/api/authentication" --json

Tips

  • Map is URL discovery only — no content extraction. Use extract or crawl for content.

  • Map + extract beats crawl when you only need a few specific pages from a large site.

  • Use --instructions for semantic filtering when path patterns aren't enough.

See also

Weekly Installs266Repositorytavily-ai/skillsGitHub Stars95First Seen2 days agoSecurity AuditsGen Agent Trust HubFailSocketPassSnykFailInstalled oncodex261opencode260cursor260kimi-cli259gemini-cli259amp259

用户评价 (0)

发表评价

效果
易用性
文档
兼容性

暂无评价

统计数据

安装量6.7K
评分4.5 / 5.0
版本
更新日期2026年5月23日
对比案例1 组

用户评分

4.5(44)
5
32%
4
50%
3
16%
2
2%
1
0%

为此 Skill 评分

0.0

兼容平台

🔧Claude Code

时间线

创建2026年3月18日
最后更新2026年5月23日