This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch handle_predicate_right_side_expression
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 47f0e8b Address comments
discard 557ad7c Adding more sql tests
discard ba1f4ca Support case like WHERE 0=b
discard 0852fc8 Support non-literal expression in right side of comparison
operators
discard e406b59 Update predicate expression
add 2a79531 Support Text Search (#4993)
add a257935 Support no global-dictionary columns in data anonymizer
(#5071)
add 4be7490 Use getResourceAsStream to load test resource file packaged
inside (#5072)
add 9c65deb Reduce the non-determinism in lucene integration test (#5077)
add 94122e8 [TE] frontend - harleyjj/alerts - update application filter
for many-to-many relationship (#5062)
add 884af43 [TE] Remove fromAddress as a compulsory field from
subscription group (#5078)
add 4779341 Disbale text query realtime integration test (#5079)
add 3c78a8c [TE] add initial delay upon receiving events in scheduling
(#5060)
add c613f46 [TE] Adjust dectection window using expected delay (#5059)
add 7dfc5c1 Adding quickstart into Pinot admin command (#5080)
add ef69b75 [TE][subscription] Fix duplicate anomaly report issue and
clean up subscription pipelines (#5081)
add 35f2117 [TE][subscription] Minor bug fix in the empty email check
(#5084)
add 21850ba Support text index load for V1 segment format (#5085)
add d5c8398 Support creation of inverted index on a new column in V1
segment (#5087)
add 4124563 Support segment reload for text index (#5074)
add e44192e Support embedded parsing in PinotDataAndQueryAnonymizer
(#5088)
add f247e77 Plug in the new routing introduced in #5046 (#5082)
add ef6509e Minor improvement for RoutingManager (#5092)
add b2608ad [TE] Upgrade mysql version to 5.1.41 to fix compatibility
issues connectin with 8.* (#5093)
add 9f44cab Update predicate expression
add fd9b886 Support non-literal expression in right side of comparison
operators
add b0f6ec0 Support case like WHERE 0=b
add 65cac91 Adding more sql tests
add b85abfd Address comments
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (47f0e8b)
\
N -- N -- N refs/heads/handle_predicate_right_side_expression
(b85abfd)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../broker/api/resources/PinotBrokerDebug.java | 111 +-
.../api/resources/PinotBrokerHealthCheck.java | 17 +-
.../broker/api/resources/PinotBrokerRouting.java | 76 +
.../broker/api/resources/PinotClientRequest.java | 2 +-
.../broker/broker/BrokerAdminApiApplication.java | 14 +-
.../pinot/broker/broker/BrokerServerBuilder.java | 144 -
...okerResourceOnlineOfflineStateModelFactory.java | 77 +-
.../BrokerUserDefineMessageHandlerFactory.java | 92 +
.../broker/broker/helix/HelixBrokerStarter.java | 170 +-
.../TimeboundaryRefreshMessageHandlerFactory.java | 145 -
.../HelixExternalViewBasedQueryQuotaManager.java | 10 +-
.../requesthandler/BaseBrokerRequestHandler.java | 46 +-
.../SingleConnectionBrokerRequestHandler.java | 11 +-
.../pinot/broker/routing/v2/RoutingManager.java | 76 +-
.../broker/broker/HelixBrokerStarterTest.java | 37 +-
...elixExternalViewBasedQueryQuotaManagerTest.java | 4 +-
.../antlr4/org/apache/pinot/pql/parsers/PQL2.g4 | 5 +
.../apache/pinot/common/config/TableConfig.java | 6 +
.../common/config/TextIndexConfigValidator.java | 46 +
.../common/messages/SegmentRefreshMessage.java | 46 +-
.../messages/TimeboundaryRefreshMessage.java | 45 -
.../pinot/common/request/FilterOperator.java | 11 +-
.../common/response/BrokerResponseFactory.java | 117 -
.../apache/pinot/common/utils/CommonConstants.java | 8 -
.../parsers/PinotQuery2BrokerRequestConverter.java | 2 +
.../apache/pinot/pql/parsers/Pql2AstListener.java | 11 +
.../org/apache/pinot/pql/parsers/Pql2Compiler.java | 1 -
.../pinot/pql/parsers/pql2/ast/FilterKind.java | 3 +-
.../pql/parsers/pql2/ast/InPredicateAstNode.java | 4 +
...AstNode.java => TextMatchPredicateAstNode.java} | 48 +-
.../pinot/common/config/TableConfigTest.java | 39 +-
.../apache/pinot/pql/parsers/Pql2CompilerTest.java | 12 +
pinot-common/src/thrift/request.thrift | 3 +-
.../helix/core/PinotHelixResourceManager.java | 123 +-
.../validation/ValidationManagerTest.java | 6 +-
pinot-core/pom.xml | 15 +
.../org/apache/pinot/core/common/Predicate.java | 6 +-
.../{NEqPredicate.java => TextMatchPredicate.java} | 13 +-
.../realtime/LLRealtimeSegmentDataManager.java | 15 +-
.../generator/SegmentGeneratorConfig.java | 45 +
.../immutable/ImmutableSegmentLoader.java | 2 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 90 +-
.../io/reader/impl/v1/SortedIndexReaderImpl.java | 8 +
.../core/operator/filter/FilterOperatorUtils.java | 14 +-
.../operator/filter/TextMatchFilterOperator.java | 75 +
.../predicate/PredicateEvaluatorProvider.java | 8 +
.../TextMatchPredicateEvaluatorFactory.java | 58 +
.../converter/RealtimeSegmentConverter.java | 28 +-
.../core/realtime/impl/RealtimeSegmentConfig.java | 52 +-
.../invertedindex/RealtimeInvertedIndexReader.java | 8 +
.../RealtimeLuceneIndexReaderRefreshThread.java | 151 +
.../RealtimeLuceneIndexRefreshState.java | 139 +
.../RealtimeLuceneTextIndexReader.java | 162 +
.../core/segment/creator/InvertedIndexCreator.java | 13 +-
.../{ForwardIndexType.java => TextIndexType.java} | 9 +-
.../creator/impl/SegmentColumnarIndexCreator.java | 52 +-
.../core/segment/creator/impl/V1Constants.java | 1 +
.../inv/OffHeapBitmapInvertedIndexCreator.java | 5 +
.../impl/inv/OnHeapBitmapInvertedIndexCreator.java | 5 +
.../impl/inv/text/LuceneTextIndexCreator.java | 163 +
.../pinot/core/segment/index/ColumnMetadata.java | 19 +-
.../index/column/PhysicalColumnIndexContainer.java | 16 +-
.../converter/SegmentV1V2ToV3FormatConverter.java | 26 +-
.../index/data/source/ColumnDataSource.java | 6 +-
.../segment/index/loader/IndexLoadingConfig.java | 53 +
.../segment/index/loader/SegmentPreProcessor.java | 13 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 104 +-
.../loader/defaultcolumn/DefaultColumnHandler.java | 5 +-
.../defaultcolumn/DefaultColumnHandlerFactory.java | 2 +-
.../defaultcolumn/V1DefaultColumnHandler.java | 19 +-
.../defaultcolumn/V3DefaultColumnHandler.java | 40 +-
.../loader/invertedindex/TextIndexHandler.java | 179 +
.../index/readers/BitmapInvertedIndexReader.java | 8 +
.../segment/index/readers/InvertedIndexReader.java | 7 +
.../index/readers/text/LuceneDocIdCollector.java | 73 +
.../index/readers/text/LuceneTextIndexReader.java | 173 +
.../pinot/core/segment/store/ColumnIndexType.java | 3 +-
.../core/segment/store/FilePerIndexDirectory.java | 4 +
.../pinot/core/segment/store/SegmentDirectory.java | 2 +
.../core/segment/store/SegmentDirectoryPaths.java | 13 +
.../segment/store/SegmentLocalFSDirectory.java | 6 +
.../segment/store/SingleFileIndexDirectory.java | 22 +
.../virtualcolumn/DocIdVirtualColumnProvider.java | 9 +
.../SingleStringVirtualColumnProvider.java | 8 +
.../core/segment/index/loader/LoaderTest.java | 155 +
.../index/loader/SegmentPreProcessorTest.java | 163 +-
.../store/ColumnIndexDirectoryTestHelper.java | 3 +-
.../pinot/queries/TestTextSearchQueries.java | 1116 +
.../test/java/org/apache/pinot/util/TestUtils.java | 19 +-
...MVSchema.json => newColumnsWithTextSchema.json} | 8 +
.../text_search_data/group_by_grep_results.out | 26 +
.../resources/data/text_search_data/pql_query1.txt | 24150 +++++++++++++++++++
.../resources/data/text_search_data/skills.txt | 23 +
.../tests/BaseClusterIntegrationTest.java | 6 +-
.../tests/BaseClusterIntegrationTestSet.java | 115 +-
.../pinot/integration/tests/ClusterTest.java | 14 +-
.../tests/HybridClusterIntegrationTest.java | 27 +-
.../LuceneRealtimeClusterIntegrationTest.java | 191 +
.../server/starter/helix/HelixServerStarter.java | 6 +
.../org/apache/pinot/tools/HybridQuickstart.java | 3 -
.../java/org/apache/pinot/tools/Quickstart.java | 2 -
.../org/apache/pinot/tools/RealtimeQuickStart.java | 3 -
.../pinot/tools/admin/PinotAdministrator.java | 2 +
...stionJobCommand.java => QuickStartCommand.java} | 65 +-
.../anonymizer/PinotDataAndQueryAnonymizer.java | 122 +-
.../pinot/tools/TestDataAndQueryAnonymizer.java | 6 +-
pinot-tools/src/test/resources/columns.mapping | 4 +-
pinot-tools/src/test/resources/queries.generated | 4 +-
pinot-tools/src/test/resources/queries.raw | 4 +-
pom.xml | 1 +
thirdeye/pom.xml | 2 +-
.../app/pods/manage/alerts/index/controller.js | 20 +-
.../app/pods/manage/alerts/index/route.js | 12 +-
.../anomaly/ThirdEyeAnomalyApplication.java | 3 +-
.../trigger/DataAvailabilityTaskScheduler.java | 29 +-
.../DataAvailabilitySchedulingConfiguration.java | 10 +
.../trigger/utils/DatasetTriggerInfoRepo.java | 2 +-
.../thirdeye/datalayer/pojo/DatasetConfigBean.java | 6 +-
.../thirdeye/detection/DetectionPipelineJob.java | 11 -
.../apache/pinot/thirdeye/detection/TaskUtils.java | 11 +-
.../detection/alert/DetectionAlertTaskRunner.java | 11 -
.../alert/StatefulDetectionAlertFilter.java | 9 +-
.../filter/DimensionDetectionAlertFilter.java | 121 -
.../filter/DimensionsRecipientAlertFilter.java | 4 +-
.../alert/filter/PerUserDimensionAlertFilter.java | 51 +-
.../detection/alert/filter/SubscriptionUtils.java | 17 +-
.../ToAllRecipientsDetectionAlertFilter.java | 18 +-
.../alert/scheme/DetectionEmailAlerter.java | 10 +-
.../validators/SubscriptionConfigValidator.java | 1 -
.../formatter/DetectionConfigFormatter.java | 12 +-
.../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 22 +
.../trigger/DataAvailabilityTaskSchedulerTest.java | 35 +-
.../detection/alert/filter/AlertFilterUtils.java | 12 +
.../filter/DimensionDetectionAlertFilterTest.java | 197 -
.../filter/PerUserDimensionAlertFilterTest.java | 17 +-
.../ToAllRecipientsDetectionAlertFilterTest.java | 42 +-
136 files changed, 28855 insertions(+), 1583 deletions(-)
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/api/resources/PinotBrokerRouting.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/broker/BrokerServerBuilder.java
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/BrokerUserDefineMessageHandlerFactory.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/TimeboundaryRefreshMessageHandlerFactory.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/TextIndexConfigValidator.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/messages/TimeboundaryRefreshMessage.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/response/BrokerResponseFactory.java
copy
pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/{RegexpLikePredicateAstNode.java
=> TextMatchPredicateAstNode.java} (54%)
copy
pinot-core/src/main/java/org/apache/pinot/core/common/predicate/{NEqPredicate.java
=> TextMatchPredicate.java} (78%)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/operator/filter/TextMatchFilterOperator.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/operator/filter/predicate/TextMatchPredicateEvaluatorFactory.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneIndexReaderRefreshThread.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneIndexRefreshState.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneTextIndexReader.java
copy
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/{ForwardIndexType.java
=> TextIndexType.java} (91%)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/inv/text/LuceneTextIndexCreator.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/invertedindex/TextIndexHandler.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/text/LuceneDocIdCollector.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/text/LuceneTextIndexReader.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/queries/TestTextSearchQueries.java
copy pinot-core/src/test/resources/data/{testDataMVSchema.json =>
newColumnsWithTextSchema.json} (88%)
create mode 100644
pinot-core/src/test/resources/data/text_search_data/group_by_grep_results.out
create mode 100644
pinot-core/src/test/resources/data/text_search_data/pql_query1.txt
create mode 100644
pinot-core/src/test/resources/data/text_search_data/skills.txt
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/LuceneRealtimeClusterIntegrationTest.java
copy
pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/{LaunchDataIngestionJobCommand.java
=> QuickStartCommand.java} (54%)
delete mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionDetectionAlertFilter.java
delete mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionDetectionAlertFilterTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
