GH-533: Adaptive Lossless Floating-Point (ALP) Encoding #548
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is a proposed implementation of the ALP described in
"ALP: Adaptive Lossless floating-Point Compression" (SIGMOD 2024, https://dl.acm.org/doi/10.1145/3626717
It is based on (largely a reformatted version of) @prtkgaur 's ALP Encoding Specification Google Doc
See rendered preview here: https://github.com/alamb/parquet-format/blob/alamb/alp/Encodings.md#adaptive-lossless-floating-point-adaptive_lossless_floating_point--10
Rationale for this change
This encoding has the following properties:
See Mailing List Discussion: https://lists.apache.org/thread/tjtln1mmjqfoql1ls2dw9xpdk91r1909
Source ALP Results Document
(Todo summarize the mailing list discussion here)
What changes are included in this PR?
Do these changes have PoC implementations?
Yes