Skip to content

parquet: Add bit-packing benchmarks - #10667

Merged
Jefffrey merged 1 commit into
apache:mainfrom
sdf-jkl:agent/bit-packing-benchmarks
Aug 14, 2026
Merged

parquet: Add bit-packing benchmarks#10667
Jefffrey merged 1 commit into
apache:mainfrom
sdf-jkl:agent/bit-packing-benchmarks

Conversation

@sdf-jkl

@sdf-jkl sdf-jkl commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

  • We need a bench to measure perf

What changes are included in this PR?

  • Added a bit-packing benchmark

  • It covers all encoding paths affected by bit
    packing:

    • PLAIN boolean encoding
    • RLE boolean encoding
    • DELTA_BINARY_PACKED for i32
    • DELTA_BINARY_PACKED for i64
    • DELTA_LENGTH_BYTE_ARRAY
    • DELTA_BYTE_ARRAY
    • Generic dictionary-index encoding
    • Arrow’s specialized byte-array dictionary-index encoding
    • Definition- and repetition-level encoding via the RLE/
      bit-packed hybrid encoder

Are these changes tested?

  • N/A

Are there any user-facing changes?

@github-actions github-actions Bot added the parquet Changes to the parquet crate label Aug 12, 2026
@sdf-jkl

sdf-jkl commented Aug 12, 2026

Copy link
Copy Markdown
Contributor Author

@Jefffrey PTAL

@Jefffrey Jefffrey added the development-process Related to development process of arrow-rs label Aug 14, 2026
@Jefffrey
Jefffrey merged commit 901e69f into apache:main Aug 14, 2026
20 checks passed
@Jefffrey

Copy link
Copy Markdown
Contributor

thanks @sdf-jkl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of arrow-rs parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants