Back to skills
extension
Category: Development & EngineeringNo API key required

crawling-content

High-speed read-only web extraction. Use when fetching documentation, blogs, and static pages. Do not use for apps requiring login or interaction.

personAuthor: jakexiaohubgithub

Content Crawler Protocol

Usage

Use @just-every/crawl for zero-latency markdown extraction.

Single Page (Read)

npx -y @just-every/crawl "https://example.com"

Site Map (Spider)

npx -y @just-every/crawl "https://example.com" --pages 20 --output json

Failure Mode

If output contains "JavaScript required" or "Access Denied", STOP. Switch to Skill(browsing-web) to handle the dynamic rendering.