tavily-map
快速发现网站上的所有URL链接,但不提取页面内容,比传统爬取更高效,适用于网站结构分析和链接资源探索。
npx skills add tavily-ai/skills --skill tavily-mapBefore / After 效果对比
1 组过去要获取一个网站的所有URL,需要手动点击或编写复杂的爬虫脚本,过程缓慢且容易遗漏重要链接。
Tavily Map技能能快速发现网站上的所有URL,且不提取内容,极大提升网站结构分析和链接发现的效率。
description SKILL.md
tavily-map
tavily map Discover URLs on a website without extracting content. Faster than crawling. Before running any command If tvly is not found on PATH, install it first: curl -fsSL https://cli.tavily.com/install.sh | bash && tvly login Do not skip this step or fall back to other tools. See tavily-cli for alternative install methods and auth options. When to use You need to find a specific subpage on a large site You want a list of all URLs before deciding what to extract or crawl Step 3 in the workflow: search → extract → map → crawl → research Quick start # Discover all URLs tvly map "https://docs.example.com" --json # With natural language filtering tvly map "https://docs.example.com" --instructions "Find API docs and guides" --json # Filter by path tvly map "https://example.com" --select-paths "/blog/.*" --limit 500 --json # Deep map tvly map "https://example.com" --max-depth 3 --limit 200 --json Options Option Description --max-depth Levels deep (1-5, default: 1) --max-breadth Links per page (default: 20) --limit Max URLs to discover (default: 50) --instructions Natural language guidance for URL filtering --select-paths Comma-separated regex patterns to include --exclude-paths Comma-separated regex patterns to exclude --select-domains Comma-separated regex for domains to include --exclude-domains Comma-separated regex for domains to exclude --allow-external / --no-external Include external links --timeout Max wait (10-150 seconds) -o, --output Save output to file --json Structured JSON output Map + Extract pattern Use map to find the right page, then extract it. This is often more efficient than crawling an entire site: # Step 1: Find the authentication docs tvly map "https://docs.example.com" --instructions "authentication" --json # Step 2: Extract the specific page you found tvly extract "https://docs.example.com/api/authentication" --json Tips Map is URL discovery only — no content extraction. Use extract or crawl for content. Map + extract beats crawl when you only need a few specific pages from a large site. Use --instructions for semantic filtering when path patterns aren't enough. See also tavily-extract — extract content from URLs you discover tavily-crawl — bulk extract when you need many pages Weekly Installs227Repositorytavily-ai/skillsGitHub Stars95First Seen2 days agoSecurity AuditsGen Agent Trust HubFailSocketPassSnykFailInstalled oncodex223opencode222cursor222kimi-cli221gemini-cli221amp221
forum用户评价 (0)
发表评价
暂无评价,来写第一条吧
统计数据
用户评分
为此 Skill 评分