Back to skills
extension
Category: Data & AnalyticsNo API key required

在网站迁移、删除或调查之前,下载该URL的所有存档快照

当代理需要某个URL的完整历史记录而不是通过Wayback Machine用户界面进行几次点击时,请使用waybackpack。代理可以列出或下载快照,按日期限制,去重存档,并在网站发生变化或消失之前将证据保存在当地。

personAuthor: user_3c6cb52ehubcommunity

在网站迁移、删除或调查之前,下载该URL的所有存档快照

Use waybackpack when an agent needs the full historical record for a URL, not a few clicks through the Wayback Machine UI. The agent can list or download snapshots, constrain by date, deduplicate archives, and preserve evidence locally before a site changes or disappears.

Prerequisites

Python 3, pip, a target URL, local disk space for archived snapshots, and optional tqdm for progress output.

Installation

Use the upstream install or setup path that matches your environment:

  • pip install waybackpack

Requirements and caveats from upstream:

  • Version [Support Python versions](https://pypi.python.org/pypi/w...
  • Requires tqdm to be installed.
  • Waypackback is written in pure Python, depends only on requests, and should work wherever Python works. Requires Python 3.3+.

Basic usage or getting-started notes:

  • For instance, to download every copy of the Department of Labor's homepage through 1996 (which happens to be the first year the site was archived), you'd run:

  • [--from-date FROM_DATE] [--to-date TO_DATE]

  • [--user-agent USER_AGENT] [--follow-redirects]

  • Source: https://github.com/1991513ccie-png/skills

  • Extracted from upstream docs: https://raw.githubusercontent.com/jsvine/waybackpack/HEAD/README.md

Documentation

  • https://github.com/1991513ccie-png/skills