This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch
data-2616-disallow-nondeterministic-transforms
in repository https://gitbox.apache.org/repos/asf/pinot.git
omit 79816a2082d Disallow non-deterministic ingestion transform configs
add e76f5e5ca0f Bump orc.version from 1.9.8 to 1.9.9 (#18943)
add 13b3ce0d928 Bump software.amazon.awssdk:bom from 2.47.1 to 2.47.3
(#18944)
add 4ec85058e65 Bump io.netty:netty-bom from 4.1.135.Final to
4.1.136.Final (#18945)
add 849c6206237 Enable broker segment pruning by default for the MSE
logical planner (and fix routing-filter construction bugs it surfaces) (#18941)
add 04a294f3e2e Add BSON (MongoDB) input format support (#18950)
add c6552066091 Support no-dictionary aggregation-key columns in consuming
segments and consolidate metrics-aggregation validation (#18955)
add e55c18172a5 Add explicit target data type constructor to
DataTypeColumnTransformer (#18954)
add 3019dc48bb1 Refactor upsert/dedup config validation into per-mode
branches (#18956)
add 8e99d01b9b7 Fix raw BYTES column min/max generation (#18952)
add 9605870ace9 Bump io.grpc:grpc-bom from 1.82.1 to 1.82.2 (#18968)
add 55302c1570e Bump software.amazon.awssdk:bom from 2.47.3 to 2.47.4
(#18967)
add 008774c76bd Bump org.roaringbitmap:RoaringBitmap from 1.6.14 to 1.6.15
(#18966)
add b474b311ecc Bump org.mongodb:bson from 5.6.1 to 5.9.0 (#18965)
add a6457514843 Fix JsonIndexConfig equals/hashCode missing _indexPaths
and _maxBytesSize (#18959)
add d25aa722e24 Add equals() and hashCode() to VectorIndexConfig (#18957)
add e244b41dec7 Sort lineage entries by timestamp then id for
deterministic list output (#18859)
add dbc50f4cad5 Follow-up to #18941: routing-filter pruner-invariant test
+ construction cleanup (#18951)
add e7b57c06ec7 Add MV BYTES and BIG_DECIMAL support to GenericRow
serializer/deserializer (#18969)
add 7bc114575e4 Disallow non-deterministic ingestion transform configs
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (79816a2082d)
\
N -- N -- N
refs/heads/data-2616-disallow-nondeterministic-transforms (7bc114575e4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
AGENTS.md | 1 +
CLAUDE.md | 1 +
LICENSE-binary | 1 +
pinot-bom/pom.xml | 5 +
.../pinot/common/lineage/SegmentLineage.java | 7 +-
.../api/PinotSegmentRestletResourceTest.java | 13 +-
.../genericrow/GenericRowDeserializer.java | 59 ++
.../genericrow/GenericRowSerializer.java | 30 +
.../processing/genericrow/GenericRowSerDeTest.java | 44 +
pinot-distribution/pinot-assembly.xml | 6 +
...PartitionLLCRealtimeClusterIntegrationTest.java | 12 +-
.../BaseLogicalTableIntegrationTest.java | 6 +-
.../{pinot-csv => pinot-bson}/pom.xml | 8 +-
.../inputformat/bson/BSONMessageDecoder.java} | 32 +-
.../inputformat/bson/BSONRecordExtractor.java | 147 ++++
.../plugin/inputformat/bson/BSONRecordReader.java | 168 ++++
.../pinot/plugin/inputformat/bson/BSONUtils.java | 57 ++
.../inputformat/bson/BSONMessageDecoderTest.java | 153 ++++
.../inputformat/bson/BSONRecordExtractorTest.java | 290 +++++++
.../inputformat/bson/BSONRecordReaderTest.java | 212 +++++
.../pinot-bson}/src/test/resources/log4j2.xml | 0
pinot-plugins/pinot-input-format/pom.xml | 1 +
.../planner/logical/LeafStageToPinotQuery.java | 77 +-
.../query/routing/PlanNodeRoutingQueryBuilder.java | 27 +-
.../apache/pinot/query/routing/WorkerManager.java | 54 +-
.../planner/logical/LeafStageToPinotQueryTest.java | 187 +++++
.../routing/PlanNodeRoutingQueryBuilderTest.java | 60 ++
.../pinot/query/routing/WorkerManagerTest.java | 286 ++++++-
.../resources/queries/ExplainPhysicalPlans.json | 33 +-
.../DataTypeColumnTransformer.java | 22 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 82 +-
.../ColumnMinMaxValueGenerator.java | 12 +-
.../segment/local/utils/TableConfigUtils.java | 787 ++++++++---------
.../DataTypeColumnTransformerTest.java | 11 +
.../MutableSegmentImplAggregateMetricsTest.java | 67 ++
.../ColumnMinMaxValueGeneratorTest.java | 173 ++++
.../segment/local/utils/TableConfigUtilsTest.java | 934 ++++++++++-----------
.../spi/index/creator/VectorIndexConfig.java | 25 +
.../spi/index/creator/VectorIndexConfigTest.java | 121 +++
.../pinot/spi/config/table/JsonIndexConfig.java | 7 +-
.../apache/pinot/spi/data/readers/FileFormat.java | 2 +-
.../spi/data/readers/RecordReaderFactory.java | 2 +
.../apache/pinot/spi/utils/CommonConstants.java | 10 +-
.../spi/config/table/JsonIndexConfigTest.java | 59 ++
.../spi/data/readers/RecordReaderFactoryTest.java | 4 +
pinot-tools/pom.xml | 4 +
pom.xml | 16 +-
47 files changed, 3270 insertions(+), 1045 deletions(-)
copy pinot-plugins/pinot-input-format/{pinot-csv => pinot-bson}/pom.xml (91%)
copy
pinot-plugins/pinot-input-format/{pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/JSONMessageDecoder.java
=>
pinot-bson/src/main/java/org/apache/pinot/plugin/inputformat/bson/BSONMessageDecoder.java}
(63%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-bson/src/main/java/org/apache/pinot/plugin/inputformat/bson/BSONRecordExtractor.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-bson/src/main/java/org/apache/pinot/plugin/inputformat/bson/BSONRecordReader.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-bson/src/main/java/org/apache/pinot/plugin/inputformat/bson/BSONUtils.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-bson/src/test/java/org/apache/pinot/plugin/inputformat/bson/BSONMessageDecoderTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-bson/src/test/java/org/apache/pinot/plugin/inputformat/bson/BSONRecordExtractorTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-bson/src/test/java/org/apache/pinot/plugin/inputformat/bson/BSONRecordReaderTest.java
copy {pinot-broker =>
pinot-plugins/pinot-input-format/pinot-bson}/src/test/resources/log4j2.xml
(100%)
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/loader/columnminmaxvalue/ColumnMinMaxValueGeneratorTest.java
create mode 100644
pinot-segment-spi/src/test/java/org/apache/pinot/segment/spi/index/creator/VectorIndexConfigTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
