feat: Migrate bitmap file index implementation by lxy-9602 · Pull Request #49 · apache/paimon-cpp · GitHub
Skip to content

feat: Migrate bitmap file index implementation - #49

Merged
leaves12138 merged 1 commit into
apache:mainfrom
lxy-9602:bitmap-file-index
Jun 5, 2026
Merged

feat: Migrate bitmap file index implementation#49
leaves12138 merged 1 commit into
apache:mainfrom
lxy-9602:bitmap-file-index

Conversation

@lxy-9602

@lxy-9602 lxy-9602 commented Jun 5, 2026

Copy link
Copy Markdown
Member

Purpose

No Linked issue.

Migrate bitmap file index implementation — the core secondary index for accelerating point lookups and equality filters:

Bitmap file index (src/paimon/common/file_index/bitmap/):

  • BitmapFileIndex — bitmap-based file index reader/writer supporting equality and IN-list queries (bitmap_file_index.h/cpp)
  • BitmapFileIndexMeta — abstract metadata describing bitmap index layout and column mappings (bitmap_file_index_meta.h/cpp)
  • BitmapFileIndexMetaV1 — v1 metadata format with fixed-width bitmap entries (bitmap_file_index_meta_v1.h/cpp)
  • BitmapFileIndexMetaV2 — v2 metadata format with variable-length entries and null bitmap support (bitmap_file_index_meta_v2.h/cpp)
  • ApplyBitmapIndexBatchReader — batch reader that applies bitmap index filtering to row batches (apply_bitmap_index_batch_reader.h)
  • BitmapIndexResult — bitmap-backed query result with intersection/union operations (bitmap_index_result.cpp)
  • BitmapFileIndexFactory — factory for registering bitmap file index implementation (bitmap_file_index_factory.h/cpp)

Tests

  • bitmap_file_index_test.cpp — end-to-end bitmap index write/read, equality/IN queries, multi-type support
  • bitmap_file_index_meta_test.cpp — metadata serialization round-trip for v1 and v2 formats
  • apply_bitmap_index_batch_reader_test.cpp — batch reader filtering with bitmap index
  • bitmap_index_result_test.cpp — bitmap result set operations

API and Format

API and Format

Documentation

Generative AI tooling

Migrate-by: Aone Copilot (Claude)

@leaves12138

Copy link
Copy Markdown
Contributor

@leaves12138

Copy link
Copy Markdown
Contributor

@leaves12138 leaves12138 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No blocking issues found for this staged intermediate.

@leaves12138
leaves12138 merged commit 546112c into apache:main Jun 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants