Back to skills
extension
Category: Data & AnalyticsNo API key required

Parquet 列裁剪优化器

使用PyArrow列裁剪和谓词下推优化Apache Parquet文件读取。分析查询模式以推荐行组大小和字典编码策略。

personAuthor: user_3c6cb52ehubcommunity

Parquet 列裁剪优化器

Optimizes Apache Parquet file reads using PyArrow column pruning and predicate pushdown. Analyzes query patterns to recommend row group sizing and dictionary encoding strategies.

Installation

Use the upstream install or setup path that matches your environment:

  • $ npm install parquetjs

Requirements and caveats from upstream:

  • This project requires a major overhaul, as well as handling and sorting through dozens of issues and prs.
  • fully asynchronous, pure node.js implementation of the Parquet file format
  • To use parquet.js with node.js, install it using npm:

Basic usage or getting-started notes:



  • Once you have installed the parquet.js library, you can import it as a single

  • Source: https://github.com/1991513ccie-png/skills

  • Extracted from upstream docs: https://raw.githubusercontent.com/ironSource/parquetjs/HEAD/README.md