shield_lock
JinDaGe
← Back to skills
extension
Category: Data & AnalyticsNo API key required

Puppeteer 网页抓取流水线

使用 Puppeteer 构建网页抓取管道，采用 page.evaluate、page.waitForSelector 和 browser.newPage。处理无限滚动、Cookie 同意横幅和反机器人检测，使用 stealth 插件。

personAuthor: user_3c6cb52ehubcommunity
downloadDownload package

Puppeteer 网页抓取流水线

Builds web scraping pipelines with Puppeteer using page.evaluate, page.waitForSelector, and browser.newPage. Handles infinite scroll, cookie consent banners, and anti-bot detection with stealth plugin.

Installation

Use the upstream install or setup path that matches your environment:

  • npm i puppeteer # Downloads compatible Chrome during installation.
  • npm i puppeteer-core # Alternatively, install as a library, without downloading Chrome.

Basic usage or getting-started notes:

  • bash npm2yarn

  • MCP

  • a Puppeteer-based MCP server for browser automation and debugging.

  • Source: https://github.com/1991513ccie-png/skills

  • Extracted from upstream docs: https://raw.githubusercontent.com/puppeteer/puppeteer/HEAD/README.md

Documentation

  • https://pptr.dev/