xiangfu0 opened a new pull request, #18474: URL: https://github.com/apache/pinot/pull/18474
## Summary - Add `realtimeConfig.consumingSegmentIndexConfig` to model realtime consuming-segment-only index overrides. - Apply the consuming profile only while building mutable realtime consuming segments, with validation and a server fallback meter. - Keep committed immutable segments on the normal table config/tier overwrite path, and add a sample config plus user-facing docs. ## Why Realtime consuming segments sometimes need faster lookup/index behavior than committed segments, but overloading tiered storage config for that behavior mixes two different concerns. This keeps consuming-only index behavior explicit and avoids requiring a synthetic CONSUMING tier. ## Validation - `./mvnw -pl pinot-segment-local -am -Dtest=TableConfigConsumingSegmentIndexConfigTest -Dsurefire.failIfNoSpecifiedTests=false test` - `./mvnw -pl pinot-common -am -Dtest=TableConfigSerDeUtilsTest -Dsurefire.failIfNoSpecifiedTests=false test` - `./mvnw -pl pinot-integration-tests -am -Dskip.npm=true -Dtest=ConsumingSegmentIndexProfileRealtimeTest -Dsurefire.failIfNoSpecifiedTests=false test` - `./mvnw spotless:apply -pl pinot-spi,pinot-common,pinot-core,pinot-segment-local,pinot-integration-tests,pinot-tools` - `./mvnw checkstyle:check -pl pinot-spi,pinot-common,pinot-core,pinot-segment-local,pinot-integration-tests,pinot-tools` - `./mvnw license:format -pl pinot-spi,pinot-common,pinot-core,pinot-segment-local,pinot-integration-tests,pinot-tools` - `./mvnw license:check -pl pinot-spi,pinot-common,pinot-core,pinot-segment-local,pinot-integration-tests,pinot-tools` ## Notes - The first supported consuming profile surface is intentionally narrow: per-column `encodingType` and `indexes.inverted`. - Unsupported profile keys/indexes are rejected during table config validation so the runtime fallback path is reserved for unexpected failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
