Web Crawl Skill

Advanced web content extraction with multiple modes and intelligent content detection.

When to Use

Use this skill when:

• User asks to "研究" / "深度研究" a topic
• User wants to "抓取" / "提取" content from websites
• Need to analyze multiple web pages systematically
• Current web_fetch output is insufficient

Extraction Modes

| Mode | Use Case | |------|----------| | text | Clean plain text | | markdown | Formatted Markdown (recommended) | | links | Extract all links | | structured | JSON metadata + content | | full | Markdown + links combined |

Tools Available

• web_crawl - Extract content from a single URL
• parallel_crawl - Extract from multiple URLs in parallel
• research_topic - Multi-step research with search + crawl

Example Usage

User: "研究一下 OpenManus-Max 项目"
→ Use research_topic tool with query="OpenManus-Max GitHub features"