feat(format): introduce parquet format components by zjw1111 · Pull Request #48 · apache/paimon-cpp · GitHub
Skip to content

feat(format): introduce parquet format components - #48

Merged
leaves12138 merged 1 commit into
apache:mainfrom
zjw1111:migrate/parquet-format
Jun 4, 2026
Merged

feat(format): introduce parquet format components#48
leaves12138 merged 1 commit into
apache:mainfrom
zjw1111:migrate/parquet-format

Conversation

@zjw1111

@zjw1111 zjw1111 commented Jun 4, 2026

Copy link
Copy Markdown
Collaborator

Purpose

Linked issue: close #xxx

Introduce selected Parquet format components migrated from the Alibaba source repository:

  • Parquet file format definitions and factory files
  • Parquet reader and writer builder files
  • Parquet schema utility files
  • Parquet field id converter files and tests
  • Parquet timestamp converter files and tests

This PR intentionally contains only the 16 requested files. Dependency closure files are left for follow-up migration batches.

License handling:

  • Replaced Alibaba-owned file headers with ASF license headers.
  • Preserved the existing ASF headers and Apache Arrow adaptation notes in parquet_schema_util.h and parquet_schema_util.cpp.
  • Added parquet_schema_util.h and parquet_schema_util.cpp to the Apache Arrow section in LICENSE; the target NOTICE already contains the Apache Arrow notice.

External contributor handling:

  • Re-ran external contributor analysis for the final migrated file list.
  • No Co-authored-by trailer was required by the migration threshold rules.

Tests

  • git diff --check
  • git diff --cached --check
  • python3 /home/jinli.zjw/.codex/skills/paimon-cpp-migrate/scripts/analyze_external_contributors.py --files ...

API and Format

This adds Parquet format implementation files under src/paimon/format/parquet/. No files under include/ are added in this PR.

Documentation

No documentation updates.

Generative AI tooling

Migrated-by: Codex

@leaves12138 leaves12138 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed PR #48 as an intermediate step in the Parquet format migration. The missing follow-up dependencies are expected to be added by later PRs, so they are not blockers for this staged split. I did not find other blockers. Approved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants