This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch xiangfu0/data-3221-11-metadata-only-pruning
in repository https://gitbox.apache.org/repos/asf/pinot.git
discard f88c13cd279 DATA-3221 (13): prune segments from column metadata
instead of materializing them
discard ee7fcb4c5bb DATA-3221 (12): make the new column-name accessor sorted
and null-safe
discard 0e165e98353 DATA-3221 (11): list physical columns without building the
segment schema
discard 4130656cf0a DATA-3221 (10): publish the segment column arrays as one
immutable pair
discard e34982b850c DATA-3221 (10): hold segment column metadata in sorted
arrays, derive the map on demand
discard dc9449ccc04 DATA-3221 (8+9 follow-up): drop the shared shape, pack
bitsPerElement instead
discard 530340a05d9 DATA-3221 (8+9): shared column shape and primitive min/max
in ColumnMetadataImpl
discard db5bb20972b Slim ColumnMetadataImpl to 72 bytes and derive the
per-segment Schema lazily
discard 2d3b32f138a Materialize immutable-segment columns lazily behind an
opt-in instance config (default off)
discard 440d13d5698 Fold PhysicalColumnIndexContainer's IndexTypeMap into a
presence mask plus dense readers
discard 98556551bab Delegate immutable DataSourceMetadata to ColumnMetadata
instead of snapshotting it
discard 862528b73b2 Share equal segment-derived FieldSpec instances through a
weak interner
discard d03dd47dcd4 Share parsed time-column names and verify custom defaults
discard 401198b4b8e Fix metadata test import order
omit e08955f13fd Canonicalize the default null value and intern per-column
strings at metadata parse time
add 26bf075d16c Skip missing consuming segment check for paused realtime
tables (#19310)
add 5771d6acea6 Defer TTL watermark bump until after segment
add/preload/replace (upsert & dedup) (#19512)
add 0ffe5f315c8 Canonicalize the default null value and intern per-column
strings at metadata parse time
add e92d1ae4878 Fix metadata test import order
add 74e7788dc62 Share parsed time-column names and verify custom defaults
add e265da96c85 Share equal segment-derived FieldSpec instances through a
weak interner
add caac2497be6 Delegate immutable DataSourceMetadata to ColumnMetadata
instead of snapshotting it
add e068c8a5d55 Fold PhysicalColumnIndexContainer's IndexTypeMap into a
presence mask plus dense readers
add c11b2378f9b Materialize immutable-segment columns lazily behind an
opt-in instance config (default off)
add a802a6b5165 Slim ColumnMetadataImpl to 72 bytes and derive the
per-segment Schema lazily
add 38e91c9db06 DATA-3221 (8+9): shared column shape and primitive min/max
in ColumnMetadataImpl
add 133d1b42a8b DATA-3221 (8+9 follow-up): drop the shared shape, pack
bitsPerElement instead
add 8352b39b74b DATA-3221 (10): hold segment column metadata in sorted
arrays, derive the map on demand
add e587985686e DATA-3221 (10): publish the segment column arrays as one
immutable pair
add 8f21fbff19d DATA-3221 (11): list physical columns without building the
segment schema
add cc68d95b6d7 DATA-3221 (12): make the new column-name accessor sorted
and null-safe
add 6b4dab22596 DATA-3221 (13): prune segments from column metadata
instead of materializing them
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f88c13cd279)
\
N -- N -- N
refs/heads/xiangfu0/data-3221-11-metadata-only-pruning (6b4dab22596)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../controller/helix/SegmentStatusChecker.java | 16 +++-
.../realtime/MissingConsumingSegmentFinder.java | 12 +++
.../controller/helix/SegmentStatusCheckerTest.java | 86 ++++++++++++++++++++++
.../dedup/BasePartitionDedupMetadataManager.java | 47 ++++++++----
...ConcurrentMapPartitionDedupMetadataManager.java | 5 +-
.../upsert/BasePartitionUpsertMetadataManager.java | 54 +++++++++-----
...oncurrentMapPartitionUpsertMetadataManager.java | 9 +--
...nUpsertMetadataManagerForConsistentDeletes.java | 10 +--
...apPartitionDedupMetadataManagerWithTTLTest.java | 31 ++++++++
...rrentMapPartitionUpsertMetadataManagerTest.java | 33 +++++++++
10 files changed, 251 insertions(+), 52 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
