url-content-loading

一个URL内容加载工具，可以从多个平台（YouTube、PTT、Twitter/X、Truth Social、Reddit、GitHub等）的URL中提取文本或元数据。当您需要从社交帖子、视频、文档或代码仓库中加载并提取内容用于爬取、数据提取或内容分析时，请使用此工具。

How to load URL content

# Explicit loader selection
uvx kabigon --loader playwright https://example.com
uvx kabigon --loader httpx https://example.com
uvx kabigon --loader firecrawl https://example.com
uvx kabigon --loader youtube https://www.youtube.com/watch?v=dQw4w9WgXcQ
uvx kabigon --loader youtube-ytdlp https://www.youtube.com/watch?v=dQw4w9WgXcQ
uvx kabigon --loader ytdlp https://www.youtube.com/watch?v=dQw4w9WgXcQ
uvx kabigon --loader twitter https://x.com/howie_serious/status/1917768568135115147
uvx kabigon --loader truthsocial https://truthsocial.com/@realDonaldTrump/posts/115830428767897167
uvx kabigon --loader reddit https://reddit.com/r/confession/comments/1q1mzej/im_a_developer_for_a_major_food_delivery_app_the/
uvx kabigon --loader ptt https://www.ptt.cc/bbs/Gossiping/M.1746078381.A.FFC.html
uvx kabigon --loader reel https://www.instagram.com/reel/CuA0XYZ1234/
uvx kabigon --loader github https://github.com/anthropics/claude-code/blob/main/plugins/ralph-wiggum/README.md
uvx kabigon --loader pdf https://example.com/document.pdf

# Compose loaders in order
# Example: try YouTube first, then fall back to `youtube-ytdlp` if captions are missing.
# `youtube-ytdlp` can download audio and transcribe it via Whisper.
uvx kabigon --loader youtube,youtube-ytdlp https://www.youtube.com/watch?v=dQw4w9WgXcQ

# If you are not sure which loader to use, rely on the default pipeline.
uvx kabigon https://www.youtube.com/watch?v=dQw4w9WgXcQ

# List supported loaders
uvx kabigon --list

Troubleshooting

Install uv if uvx is not found:

https://docs.astral.sh/uv/getting-started/installation/