返回 Skill 列表
extension
分类: 数据与分析无需 API Key

Puppeteer 网页抓取流水线

使用 Puppeteer 构建网页抓取管道,采用 page.evaluate、page.waitForSelector 和 browser.newPage。处理无限滚动、Cookie 同意横幅和反机器人检测,使用 stealth 插件。

person作者: user_3c6cb52ehubcommunity

Puppeteer 网页抓取流水线

Builds web scraping pipelines with Puppeteer using page.evaluate, page.waitForSelector, and browser.newPage. Handles infinite scroll, cookie consent banners, and anti-bot detection with stealth plugin.

Installation

Use the upstream install or setup path that matches your environment:

  • npm i puppeteer # Downloads compatible Chrome during installation.
  • npm i puppeteer-core # Alternatively, install as a library, without downloading Chrome.

Basic usage or getting-started notes:

  • bash npm2yarn

  • MCP

  • a Puppeteer-based MCP server for browser automation and debugging.

  • Source: https://github.com/1991513ccie-png/skills

  • Extracted from upstream docs: https://raw.githubusercontent.com/puppeteer/puppeteer/HEAD/README.md

Documentation

  • https://pptr.dev/