This is an automated email from the ASF dual-hosted git repository.
kishoreg pushed a change to branch range-index
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 7b2eacf Initial code dump for supporting range queries efficiently
add 20afda5 fixing presto-coordinator k8s yaml file (#5210)
add 610350a [TE] Retain the original last success task execution time if
we can't… (#5207)
add 0d5b5e2 Make text index query cache a configurable option (#5176)
add 4ee35c3 Change the logo for navbar on the website (#5214)
add 1baede8 Stream github events demo (#5189)
add fc9f2a0 [TE] Show error messages to the new UI (#5211)
add 6b1c10d Add tests for VALUEIN (#5217)
add aaacf8d Minor changes to enable setup of github events demo via Docker
add e84a3af Support order-by on BYTES column (#5213)
add df3b904 Fix travis cache (#5225)
add 7ca6f33 [TE] frontend - harleyjj/rca - reformat dimension-algorithm
table (#5206)
add a1401de [TE] frontend - harleyjj/home - use duration param to set
date range (#5198)
add 06bd2c6 [TE] endpoint - harleyjj/metricBreakdownPipeline - add flag
for ignoring score when adding dimensions to response (#5212)
add 60bc83a Revert "[TE][subscription] update subscription watermarks to
use anomaly create time instead of end time (#5152)" (#5227)
add 8f0d059 Support bootstrap mode for table rebalance (#5224)
add 6943212 enable async processing in pinot broker query api (#5229)
add 62a3e54 Add inter segment tests for text search and fix bug for
Lucene query parser creation (#5226)
add 0a890fe [TE] Remove MIGRATED_ALGORITHM type (#5172)
add 0e0eef4 Update JVM settings for scripts (#5127)
add 535700b Address extra comments in #5224 (#5230)
add 16ac894 Handle queries like count(distinct ) (#5223)
add 33fc485 fixing spark ingestion issue (#5216)
add 08844de Fix logging in AvroUtil and add test (#5232)
add 235b474 Fix the error message in RoutingManager (#5235)
add 409d717 Exclude jsr311 dependency to make pinot-quickstart work under
pinot-tools-pkg (#5241)
add 1e3e38c [TE] frontend - harleyjj/alert-details - add basic forecast
display capability to Alert Overview (#5236)
add fc2b2b7 [TE] frontend - harleyjj/alert-details - show blob in place
of graph when loading and to display error when no time series returned (#5231)
add 8b1cde8 [TE] add rate limiter to batch alert onboarding (#5234)
add 0880f10 fix generator.sh after pinot version bump (#5237)
add 79c0838 [TE] frontend - harleyjj/alert-details - fix buggy flag for
showing forecast message (#5243)
add 7f04bdf [TE] Runner to generate SLA based metric data missing alerts
(#5200)
add 881469d [TE] script to migrate subscription group watermarks from
anomaly endtime to create time. (#5244)
add 159e4bb [TE] Update notificaion template to support Data SLA
anomalies; Don't show NA for predicted values (#5242)
add c92d677 Add a new server api for download of segments. (#5221)
add 889889e include pinot-confluent-avro plugin to the distribution
(#5248)
add b20ace0 Evaluate schema transform expressions during ingestion (#5238)
add e061317 Remove groupId in pinot-adls pom file (#5255)
add ca900e4 Optimize GroovyExpressionEvaluator (#5257)
add 193fb07 Add twitter icon to README (#5251)
add 2a31111 Support Aggregation functions with multiple arguments. (#5259)
add d68ef7b Fix HDFS copy logic (#5218)
add 142a86f Derive num docs per chunk from max column value length for
varbyte raw index creator (#5256)
add e312a93 Pull out all hadoop and spark dependencies into the root pom
(#5247)
add a8a0a75 Add icon for the latest release (#5265)
add 0622d2c Re-implement ORCRecordReader (#5267)
add c577088 [TE][subscription] Subscription pipeline should use anomaly
create ti… (#5233)
add 713dd1b Use java.io.tmpdir instead of /tmp (#5270)
add 78e753b Fix file not found exception for
AvroRecordExtractorMapTypeTest (#5272)
add 7a62166 [TE] Disable alerts if it has no success run within 30 days
(#5208)
add bd79861 Issue 5261: Support AggregationFunctions with multiple
arguments (contd). (#5275)
add 52472b3 Add access control for Pinot server segment download api.
(#5260)
add fb043da Refactor configs in pinot-spi (#5262)
add 79cc2a9 Removing the explicit reference to index types in
segmentDirectory/co… (#5276)
add 4ed36ff Remove hadoop dependency in Create Segment Command (#5271)
add d8a2705 Adding allowVolumeExpansion for volume resizing and updating
zookeeper chart (#5273)
add f8b6b2b Adding Pinot S3 Filesystem Plugin (#5249)
add b29ad2e [TE] Add validations for the threshold rule anomaly filter
(#5278)
add e604468 Add proper closing of S3PinotFS and S3Client in
S3PinotFSTest. (#5287)
add 6b62a0a Fix pinot-s3 pom file (#5290)
add 410fd70 Use 8byte offsets in chunk based raw index creator (#5285)
add 8c2874b Adding range index support
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7b2eacf)
\
N -- N -- N refs/heads/range-index (8c2874b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.gitignore | 1 +
.travis.yml | 3 +
.travis/.travis_quickstart.sh | 4 -
.travis/.travis_test.sh | 9 -
README.md | 7 +-
docker/images/pinot/bin/generator.sh | 2 +-
kubernetes/helm/charts/zookeeper-2.0.0.tgz | Bin 10633 -> 0 bytes
kubernetes/helm/charts/zookeeper-2.1.3.tgz | Bin 0 -> 10623 bytes
kubernetes/helm/gke-pd.yaml | 1 +
kubernetes/helm/gke-ssd.yaml | 1 +
kubernetes/helm/pinot-github-events-setup.yml | 279 +++++++++++
kubernetes/helm/presto-coordinator.yaml | 1 +
kubernetes/helm/requirements.lock | 6 +-
kubernetes/helm/requirements.yaml | 2 +-
.../skaffold/gke/gke-storageclass-kafka-pd.yml | 1 +
.../gke/gke-storageclass-pinot-controller-pd.yml | 1 +
.../gke/gke-storageclass-pinot-server-pd.yml | 1 +
kubernetes/skaffold/gke/gke-storageclass-zk-pd.yml | 1 +
pinot-broker/pom.xml | 14 +
.../broker/api/resources/PinotBrokerDebug.java | 2 +-
.../broker/api/resources/PinotClientRequest.java | 35 +-
...okerResourceOnlineOfflineStateModelFactory.java | 2 +-
.../HelixExternalViewBasedQueryQuotaManager.java | 6 +-
.../requesthandler/BaseBrokerRequestHandler.java | 31 +-
.../pinot/broker/routing/RoutingManager.java | 14 +-
.../instanceselector/InstanceSelectorFactory.java | 6 +-
.../segmentpruner/SegmentPrunerFactory.java | 10 +-
.../segmentselector/SegmentSelectorFactory.java | 4 +-
.../routing/timeboundary/TimeBoundaryManager.java | 4 +-
.../broker/broker/HelixBrokerStarterTest.java | 4 +-
...elixExternalViewBasedQueryQuotaManagerTest.java | 6 +-
.../request/PqlAndCalciteSqlCompatibilityTest.java | 55 ++-
.../instanceselector/InstanceSelectorTest.java | 6 +-
.../routing/segmentpruner/SegmentPrunerTest.java | 12 +-
.../segmentselector/SegmentSelectorTest.java | 4 +-
.../timeboundary/TimeBoundaryManagerTest.java | 4 +-
.../assignment/InstanceAssignmentConfigUtils.java | 16 +-
.../common/assignment/InstancePartitionsUtils.java | 6 +-
.../pinot/common/metadata/ZKMetadataProvider.java | 4 +-
.../pinot/common/request/AggregationInfo.java | 215 +++++++--
.../apache/pinot/common/utils/CommonConstants.java | 3 +
.../org/apache/pinot/common/utils/DataTable.java | 3 +
.../org/apache/pinot/common/utils/StringUtil.java | 1 +
.../pinot/common/utils/config/InstanceUtils.java | 2 +-
.../common/utils/config/TableConfigUtils.java | 24 +-
.../pinot/common/utils/config/TagNameUtils.java | 8 +-
.../pinot/common/utils/helix/TableCache.java | 2 +-
.../common/utils/request/HavingQueryTree.java | 2 +-
.../apache/pinot/parsers/CompilerConstants.java | 23 +-
.../utils/BrokerRequestComparisonUtils.java | 45 +-
.../parsers/PinotQuery2BrokerRequestConverter.java | 61 +--
.../org/apache/pinot/pql/parsers/Pql2Compiler.java | 2 -
.../pql/parsers/pql2/ast/FunctionCallAstNode.java | 72 ++-
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 9 +-
.../common/utils/config/TableConfigSerDeTest.java | 32 +-
.../common/utils/config/TableConfigUtilsTest.java | 6 +-
.../common/utils/config/TagNameUtilsTest.java | 4 +-
.../apache/pinot/pql/parsers/Pql2CompilerTest.java | 12 +-
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 221 ++++++---
pinot-common/src/test/resources/pql_queries.list | 8 +
pinot-common/src/test/resources/sql_queries.list | 8 +
pinot-common/src/thrift/request.thrift | 5 +
pinot-controller/pom.xml | 14 +
.../api/events/DefaultMetadataEventNotifier.java | 2 +-
.../api/events/MetadataEventNotifier.java | 2 +-
.../pinot/controller/api/resources/Constants.java | 2 +-
.../PinotInstanceAssignmentRestletResource.java | 6 +-
.../resources/PinotInstanceRestletResource.java | 2 +-
.../api/resources/PinotSchemaRestletResource.java | 2 +-
.../api/resources/PinotSegmentRestletResource.java | 2 +-
.../api/resources/PinotTableIndexingConfigs.java | 2 +-
.../api/resources/PinotTableInstances.java | 2 +-
.../api/resources/PinotTableMetadataConfigs.java | 2 +-
.../api/resources/PinotTableRestletResource.java | 8 +-
.../api/resources/PinotTableSegmentConfigs.java | 2 +-
.../api/resources/PinotTenantRestletResource.java | 6 +-
.../pinot/controller/api/resources/TableViews.java | 2 +-
.../controller/api/upload/SegmentValidator.java | 2 +-
.../helix/ControllerRequestURLBuilder.java | 2 +-
.../controller/helix/SegmentStatusChecker.java | 2 +-
.../helix/core/PinotHelixResourceManager.java | 18 +-
.../helix/core/PinotTableIdealStateBuilder.java | 2 +-
.../instance/InstanceAssignmentDriver.java | 8 +-
.../InstanceReplicaGroupPartitionSelector.java | 2 +-
.../instance/InstanceTagPoolSelector.java | 2 +-
.../segment/OfflineSegmentAssignment.java | 167 +++----
.../segment/RealtimeSegmentAssignment.java | 137 ++++--
.../core/assignment/segment/SegmentAssignment.java | 4 +-
.../segment/SegmentAssignmentFactory.java | 4 +-
.../assignment/segment/SegmentAssignmentUtils.java | 49 ++
.../helix/core/minion/ClusterInfoProvider.java | 2 +-
.../helix/core/minion/PinotTaskManager.java | 4 +-
.../generator/ConvertToRawIndexTaskGenerator.java | 6 +-
.../core/minion/generator/PinotTaskGenerator.java | 2 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 8 +-
.../core/realtime/PinotRealtimeSegmentManager.java | 4 +-
.../helix/core/realtime/TableConfigCache.java | 2 +-
.../core/rebalance/RebalanceConfigConstants.java | 5 +
.../helix/core/rebalance/RebalanceResult.java | 2 +-
.../helix/core/rebalance/TableRebalancer.java | 14 +-
.../core/relocation/RealtimeSegmentRelocator.java | 2 +-
.../helix/core/retention/RetentionManager.java | 4 +-
.../controller/util/AutoAddInvertedIndex.java | 4 +-
.../controller/util/SegmentIntervalUtils.java | 2 +-
.../controller/util/TableRetentionValidator.java | 4 +-
.../pinot/controller/util/TableSizeReader.java | 2 +-
.../BrokerResourceValidationManager.java | 2 +-
.../validation/OfflineSegmentIntervalChecker.java | 6 +-
.../RealtimeSegmentValidationManager.java | 4 +-
.../controller/validation/StorageQuotaChecker.java | 4 +-
.../pinot/controller/api/PinotFileUploadTest.java | 4 +-
...PinotInstanceAssignmentRestletResourceTest.java | 16 +-
.../api/PinotInstanceRestletResourceTest.java | 4 +-
.../api/PinotSegmentRestletResourceTest.java | 4 +-
.../api/PinotTableRestletResourceTest.java | 6 +-
.../api/PinotTenantRestletResourceTest.java | 2 +-
.../pinot/controller/api/TableViewsTest.java | 4 +-
.../controller/api/upload/ZKOperatorTest.java | 4 +-
.../helix/ControllerInstanceToggleTest.java | 4 +-
.../controller/helix/ControllerSentinelTestV2.java | 4 +-
.../pinot/controller/helix/ControllerTest.java | 4 +-
.../controller/helix/PinotResourceManagerTest.java | 4 +-
.../helix/core/PinotHelixResourceManagerTest.java | 16 +-
.../instance/InstanceAssignmentTest.java | 18 +-
...fflineNonReplicaGroupSegmentAssignmentTest.java | 36 +-
.../OfflineReplicaGroupSegmentAssignmentTest.java | 77 ++-
...altimeNonReplicaGroupSegmentAssignmentTest.java | 65 ++-
.../RealtimeReplicaGroupSegmentAssignmentTest.java | 67 ++-
.../PinotLLCRealtimeSegmentManagerTest.java | 6 +-
.../core/rebalance/TableRebalancerClusterTest.java | 12 +-
.../helix/core/retention/RetentionManagerTest.java | 4 +-
.../validation/StorageQuotaCheckerTest.java | 6 +-
.../validation/ValidationManagerTest.java | 4 +-
.../core/common/RowBasedBlockValueFetcher.java | 34 +-
.../core/common/datatable/DataTableBuilder.java | 46 +-
.../core/common/datatable/DataTableImplV2.java | 8 +
.../core/data/manager/BaseTableDataManager.java | 7 +-
.../pinot/core/data/manager/TableDataManager.java | 8 +-
.../manager/config/TableDataManagerConfig.java | 4 +-
.../manager/offline/TableDataManagerProvider.java | 2 +-
.../realtime/HLRealtimeSegmentDataManager.java | 4 +-
.../realtime/LLRealtimeSegmentDataManager.java | 10 +-
.../manager/realtime/RealtimeTableDataManager.java | 4 +-
.../recordtransformer/CompositeTransformer.java | 7 +-
.../recordtransformer/DataTypeTransformer.java | 2 +-
.../recordtransformer/ExpressionTransformer.java | 26 +-
.../data/recordtransformer/TimeTransformer.java | 99 ----
.../java/org/apache/pinot/core/data/table/Key.java | 37 +-
.../org/apache/pinot/core/data/table/Record.java | 37 +-
.../generator/SegmentGeneratorConfig.java | 10 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 4 +-
.../reader/impl/v1/BaseChunkSingleValueReader.java | 27 +-
.../impl/v1/VarByteChunkSingleValueReader.java | 10 +-
.../writer/impl/v1/BaseChunkSingleValueWriter.java | 30 +-
.../impl/v1/FixedByteChunkSingleValueWriter.java | 5 +-
.../impl/v1/VarByteChunkSingleValueWriter.java | 15 +-
.../apache/pinot/core/minion/SegmentConverter.java | 2 +-
.../minion/rollup/MergeRollupSegmentConverter.java | 2 +-
.../operator/CombineGroupByOrderByOperator.java | 25 +-
.../pinot/core/operator/CombineOperator.java | 3 +-
.../operator/blocks/IntermediateResultsBlock.java | 41 +-
.../core/operator/filter/FilterOperatorUtils.java | 4 +-
.../core/operator/filter/RangeFilterOperator.java | 21 +-
.../filter/predicate/PredicateEvaluator.java | 3 +
.../query/DictionaryBasedAggregationOperator.java | 2 +-
.../core/operator/query/SelectionOnlyOperator.java | 3 +-
.../operator/query/SelectionOrderByOperator.java | 14 +-
.../plan/DictionaryBasedAggregationPlanNode.java | 2 +-
.../plan/MetadataBasedAggregationPlanNode.java | 2 +-
.../apache/pinot/core/plan/TransformPlanNode.java | 9 +-
.../core/plan/maker/InstancePlanMakerImplV2.java | 2 +-
.../aggregation/AggregationFunctionContext.java | 36 +-
.../aggregation/DefaultAggregationExecutor.java | 32 +-
.../core/query/aggregation/DistinctTable.java | 16 +-
.../aggregation/function/AggregationFunction.java | 15 +-
.../function/AggregationFunctionFactory.java | 76 +--
.../function/AggregationFunctionUtils.java | 62 ++-
.../function/AvgAggregationFunction.java | 53 ++-
.../function/AvgMVAggregationFunction.java | 21 +-
.../function/CountAggregationFunction.java | 33 +-
.../function/CountMVAggregationFunction.java | 29 +-
.../function/DistinctAggregationFunction.java | 51 +-
.../function/DistinctCountAggregationFunction.java | 70 ++-
.../DistinctCountHLLAggregationFunction.java | 77 ++-
.../DistinctCountHLLMVAggregationFunction.java | 58 ++-
.../DistinctCountMVAggregationFunction.java | 58 ++-
.../DistinctCountRawHLLAggregationFunction.java | 39 +-
.../DistinctCountRawHLLMVAggregationFunction.java | 8 +-
.../function/FastHLLAggregationFunction.java | 33 +-
.../function/MaxAggregationFunction.java | 33 +-
.../function/MaxMVAggregationFunction.java | 21 +-
.../function/MinAggregationFunction.java | 32 +-
.../function/MinMVAggregationFunction.java | 21 +-
.../function/MinMaxRangeAggregationFunction.java | 51 +-
.../function/MinMaxRangeMVAggregationFunction.java | 21 +-
.../function/PercentileAggregationFunction.java | 41 +-
.../function/PercentileEstAggregationFunction.java | 58 ++-
.../PercentileEstMVAggregationFunction.java | 35 +-
.../function/PercentileMVAggregationFunction.java | 35 +-
.../PercentileTDigestAggregationFunction.java | 57 ++-
.../PercentileTDigestMVAggregationFunction.java | 35 +-
.../function/SumAggregationFunction.java | 32 +-
.../function/SumMVAggregationFunction.java | 21 +-
.../groupby/DefaultGroupByExecutor.java | 16 +-
.../query/reduce/AggregationDataTableReducer.java | 9 +-
.../pinot/core/query/reduce/CombineService.java | 12 +-
.../query/reduce/DistinctDataTableReducer.java | 51 +-
.../core/query/reduce/GroupByDataTableReducer.java | 11 +-
.../query/reduce/SelectionDataTableReducer.java | 13 +-
.../core/query/request/ServerQueryRequest.java | 5 +-
.../query/selection/SelectionOperatorService.java | 69 ++-
.../query/selection/SelectionOperatorUtils.java | 190 +++++---
.../converter/RealtimeSegmentConverter.java | 4 +-
.../core/segment/creator/StatsCollectorConfig.java | 2 +-
.../fwd/SingleValueVarByteRawIndexCreator.java | 11 +-
.../impl/inv/DictionaryBasedRangeIndexCreator.java | 416 -----------------
.../creator/impl/inv/RangeIndexCreator.java | 471 +++++++++++++++++++
.../index/column/PhysicalColumnIndexContainer.java | 9 +-
.../segment/index/loader/IndexLoadingConfig.java | 25 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 3 +-
.../loader/invertedindex/RangeIndexHandler.java | 31 +-
.../loader/invertedindex/TextIndexHandler.java | 4 +-
...RangeIndexReader.java => RangeIndexReader.java} | 113 ++++-
.../index/readers/text/LuceneTextIndexReader.java | 26 +-
.../segment/memory/PinotNativeOrderLBuffer.java | 2 +-
.../segment/memory/PinotNonNativeOrderLBuffer.java | 2 +-
.../core/segment/store/ColumnIndexDirectory.java | 107 +----
.../core/segment/store/FilePerIndexDirectory.java | 87 +---
.../segment/store/SegmentLocalFSDirectory.java | 46 +-
.../segment/store/SingleFileIndexDirectory.java | 71 +--
.../apache/pinot/core/startree/StarTreeUtils.java | 5 +-
.../executor/StarTreeAggregationExecutor.java | 20 +-
.../startree/executor/StarTreeGroupByExecutor.java | 36 +-
.../v2/builder/StarTreeV2BuilderConfig.java | 2 +-
.../apache/pinot/core/transport/QueryRouter.java | 2 +-
.../pinot/core/transport/ServerInstance.java | 2 +-
.../core/transport/ServerRoutingInstance.java | 2 +-
.../apache/pinot/core/util/ReplicationUtils.java | 6 +-
.../realtime/LLRealtimeSegmentDataManagerTest.java | 2 +-
.../data/readers/RecordReaderSampleDataTest.java | 88 ++--
.../ExpressionTransformerTest.java | 162 +++++++
.../ExpressionTransformerTimeTest.java | 182 ++++++++
.../recordtransformer/TimeTransformerTest.java | 151 ------
.../pinot/core/data/table/IndexedTableTest.java | 41 +-
.../pinot/core/data/table/TableResizerTest.java | 27 +-
.../function/AggregationFunctionFactoryTest.java | 122 +++--
.../index/creator/RangeIndexCreatorTest.java | 148 ++++++
.../index/creator/SegmentPartitionTest.java | 4 +-
.../store/ColumnIndexDirectoryTestHelper.java | 44 +-
.../segment/store/FilePerIndexDirectoryTest.java | 18 +-
.../store/SingleFileIndexDirectoryTest.java | 14 +-
.../pinot/core/transport/QueryRoutingTest.java | 2 +-
.../FixedByteChunkSingleValueReaderWriteTest.java | 25 +-
.../VarByteChunkSingleValueReaderWriteTest.java | 120 ++++-
.../org/apache/pinot/queries/BaseQueriesTest.java | 2 +-
.../apache/pinot/queries/DistinctQueriesTest.java | 84 +++-
...erSegmentAggregationSingleValueQueriesTest.java | 4 -
...InnerSegmentSelectionMultiValueQueriesTest.java | 21 +-
...nnerSegmentSelectionSingleValueQueriesTest.java | 27 +-
...terSegmentAggregationMultiValueQueriesTest.java | 79 ++++
...erSegmentAggregationSingleValueQueriesTest.java | 3 -
...erSegmentResultTableSingleValueQueriesTest.java | 2 -
.../org/apache/pinot/queries/QueriesTestUtils.java | 38 ++
.../RangePredicateWithSortedInvertedIndexTest.java | 6 +-
.../pinot/queries/TextSearchQueriesTest.java | 114 ++++-
.../DefaultAggregationExecutorTest.java | 6 +-
.../AggregationGroupByTrimmingServiceTest.java | 15 +-
.../selection/SelectionOperatorServiceTest.java | 101 ++--
.../groovy_expression_transformer.json | 62 +++
.../src/test/resources/data/fixedByteCompressed.v2 | Bin 0 -> 8098 bytes
pinot-core/src/test/resources/data/fixedByteRaw.v2 | Bin 0 -> 16036 bytes
.../resources/data/varByteStringsCompressed.v2 | Bin 0 -> 17355 bytes
.../src/test/resources/data/varByteStringsRaw.v2 | Bin 0 -> 286902 bytes
pinot-distribution/pinot-assembly.xml | 4 +
pinot-integration-tests/pom.xml | 3 -
.../tests/BaseClusterIntegrationTest.java | 14 +-
.../pinot/integration/tests/ClusterTest.java | 66 +--
.../ControllerPeriodicTasksIntegrationTests.java | 17 +-
...vertToRawIndexMinionClusterIntegrationTest.java | 2 +-
.../DefaultCommitterRealtimeIntegrationTest.java | 2 +-
.../tests/HybridClusterIntegrationTest.java | 4 +-
...ridClusterIntegrationTestCommandLineRunner.java | 2 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 4 +-
.../LuceneRealtimeClusterIntegrationTest.java | 2 +-
.../tests/MapTypeClusterIntegrationTest.java | 10 +-
.../tests/OfflineClusterIntegrationTest.java | 49 +-
.../tests/SimpleMinionClusterIntegrationTest.java | 14 +-
.../apache/pinot/perf/BenchmarkCombineGroupBy.java | 15 +-
.../perf/BenchmarkGroovyExpressionEvaluation.java | 190 ++++++++
.../apache/pinot/perf/BenchmarkIndexedTable.java | 16 +-
.../batch/common/SegmentGenerationTaskRunner.java | 4 +-
.../batch/common/SegmentGenerationUtils.java | 18 +-
.../batch/common/TestSegmentGenerationUtils.java | 31 +-
.../pinot-batch-ingestion-hadoop/pom.xml | 47 +-
.../batch/hadoop/HadoopSegmentCreationMapper.java | 3 +-
.../pinot-batch-ingestion-spark/pom.xml | 88 +---
.../spark/SparkSegmentGenerationJobRunner.java | 30 +-
.../batch/spark/SparkSegmentTarPushJobRunner.java | 7 +-
.../standalone/SegmentGenerationJobRunner.java | 2 +-
.../v0_deprecated/pinot-hadoop/pom.xml | 38 +-
.../pinot/hadoop/job/HadoopSegmentCreationJob.java | 4 +-
.../hadoop/job/HadoopSegmentPreprocessingJob.java | 12 +-
.../hadoop/job/mappers/SegmentCreationMapper.java | 4 +-
...mentBuildPushOfflineClusterIntegrationTest.java | 248 ----------
.../v0_deprecated/pinot-ingestion-common/pom.xml | 21 -
.../pinot/ingestion/common/ControllerRestApi.java | 2 +-
.../ingestion/common/DefaultControllerRestApi.java | 2 +-
.../pinot/ingestion/jobs/BaseSegmentJob.java | 2 +-
.../v0_deprecated/pinot-spark/pom.xml | 32 --
.../spark/jobs/SparkSegmentCreationFunction.java | 4 +-
.../pinot/spark/jobs/SparkSegmentCreationJob.java | 4 +-
.../pinot-batch-ingestion/v0_deprecated/pom.xml | 105 -----
pinot-plugins/pinot-file-system/pinot-adls/pom.xml | 1 -
pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml | 16 -
.../pinot/plugin/filesystem/HadoopPinotFS.java | 40 +-
.../pinot/plugin/filesystem/HadoopPinotFSTest.java | 58 +++
pinot-plugins/pinot-file-system/pinot-s3/pom.xml | 183 ++++++++
.../apache/pinot/plugin/filesystem/S3PinotFS.java | 516 +++++++++++++++++++++
.../pinot/plugin/filesystem/S3PinotFSTest.java | 316 +++++++++++++
.../pinot/plugin/filesystem/S3TestUtils.java | 45 ++
.../pinot-s3/src/test/resources/copyFile.txt | 10 +
.../pinot-s3/src/test/resources/log4j2.xml | 5 +
pinot-plugins/pinot-file-system/pom.xml | 1 +
.../inputformat/avro/AvroRecordExtractor.java | 31 +-
.../plugin/inputformat/avro/AvroRecordReader.java | 21 +-
.../pinot/plugin/inputformat/avro/AvroUtils.java | 70 ++-
.../avro/AvroRecordExtractorMapTypeTest.java | 116 +++++
.../inputformat/avro/AvroRecordExtractorTest.java | 85 ++++
.../avro/AvroRecordToPinotRowGeneratorTest.java | 13 +-
.../plugin/inputformat/avro/AvroUtilsTest.java | 66 +++
.../src/test/resources/fake_avro_schema.avsc | 0
.../inputformat/avro/KafkaAvroMessageDecoder.java | 8 +-
.../inputformat/avro/SimpleAvroMessageDecoder.java | 8 +-
...aConfluentSchemaRegistryAvroMessageDecoder.java | 31 +-
.../plugin/inputformat/csv/CSVRecordExtractor.java | 72 +++
.../inputformat/csv/CSVRecordExtractorConfig.java | 20 +-
.../plugin/inputformat/csv/CSVRecordReader.java | 26 +-
.../inputformat/csv/CSVRecordExtractorTest.java | 102 ++++
.../inputformat/csv/CSVRecordReaderTest.java | 30 ++
.../inputformat/json/JSONRecordExtractor.java | 99 ++++
.../plugin/inputformat/json/JSONRecordReader.java | 20 +-
...eaderTest.java => JSONRecordExtractorTest.java} | 34 +-
.../inputformat/json/JSONRecordReaderTest.java | 26 ++
pinot-plugins/pinot-input-format/pinot-orc/pom.xml | 28 +-
.../plugin/inputformat/orc/ORCRecordReader.java | 392 +++++++++++-----
.../inputformat/orc/ORCRecordExtractorTest.java | 120 +++++
.../inputformat/orc/ORCRecordReaderTest.java | 219 ++++-----
.../pinot-input-format/pinot-parquet/pom.xml | 16 -
.../parquet/ParquetRecordExtractor.java} | 35 +-
.../inputformat/parquet/ParquetRecordReader.java | 20 +-
.../parquet/ParquetRecordExtractorTest.java | 90 ++++
.../inputformat/thrift/ThriftRecordExtractor.java | 58 +++
.../thrift/ThriftRecordExtractorConfig.java | 21 +-
.../inputformat/thrift/ThriftRecordReader.java | 26 +-
.../pinot-kafka-base/pom.xml | 8 +
.../stream/kafka/KafkaJSONMessageDecoder.java | 38 +-
pinot-server/pom.xml | 4 +
.../pinot/server/api/access/AccessControl.java | 23 +-
.../server/api/access/AccessControlFactory.java | 15 +-
.../server/api/access/AllowAllAccessFactory.java | 21 +-
.../pinot/server/api/resources/TablesResource.java | 75 +++
.../server/starter/helix/AdminApiApplication.java | 6 +-
.../starter/helix/HelixInstanceDataManager.java | 2 +-
.../server/starter/helix/HelixServerStarter.java | 16 +-
.../SegmentOnlineOfflineStateModelFactory.java | 2 +-
.../apache/pinot/server/api/AccessControlTest.java | 87 ++++
.../apache/pinot/server/api/BaseResourceTest.java | 47 +-
.../pinot/server/api/TableSizeResourceTest.java | 55 ++-
.../pinot/server/api/TablesResourceTest.java | 114 ++++-
pinot-spi/pom.xml | 8 +
.../spi/config/{api => instance}/Instance.java | 2 +-
.../spi/config/{api => instance}/InstanceType.java | 2 +-
.../config/{ => table}/ColumnPartitionConfig.java | 3 +-
.../spi/config/{ => table}/CompletionConfig.java | 3 +-
.../pinot/spi/config/{ => table}/FieldConfig.java | 16 +-
.../spi/config/{ => table}/IndexingConfig.java | 4 +-
.../pinot/spi/config/{ => table}/QueryConfig.java | 4 +-
.../pinot/spi/config/{ => table}/QuotaConfig.java | 4 +-
.../{ => table}/ReplicaGroupStrategyConfig.java | 4 +-
.../spi/config/{ => table}/RoutingConfig.java | 4 +-
.../config/{ => table}/SegmentPartitionConfig.java | 4 +-
.../SegmentsValidationAndRetentionConfig.java | 4 +-
.../config/{ => table}/StarTreeIndexConfig.java | 4 +-
.../pinot/spi/config/{ => table}/TableConfig.java | 8 +-
.../spi/config/{ => table}/TableCustomConfig.java | 4 +-
.../spi/config/{ => table}/TableTaskConfig.java | 4 +-
.../pinot/spi/config/{ => table}/TableType.java | 2 +-
.../spi/config/{ => table}/TagOverrideConfig.java | 4 +-
.../pinot/spi/config/{ => table}/TenantConfig.java | 4 +-
.../assignment/InstanceAssignmentConfig.java | 2 +-
.../assignment/InstanceConstraintConfig.java | 2 +-
.../assignment/InstancePartitionsType.java | 2 +-
.../InstanceReplicaGroupPartitionConfig.java | 2 +-
.../assignment/InstanceTagPoolConfig.java | 2 +-
.../pinot/spi/config/{api => tenant}/Tenant.java | 2 +-
.../spi/config/{api => tenant}/TenantRole.java | 2 +-
.../java/org/apache/pinot/spi/data/Schema.java | 3 +-
.../evaluators/DefaultTimeSpecEvaluator.java | 73 +++
.../function/evaluators/ExpressionEvaluator.java | 35 +-
.../evaluators/ExpressionEvaluatorFactory.java | 114 +++++
.../evaluators/GroovyExpressionEvaluator.java | 95 ++++
.../data/readers/AbstractBaseRecordExtractor.java | 40 --
.../apache/pinot/spi/data/readers/GenericRow.java | 9 +
.../pinot/spi/data/readers/RecordExtractor.java | 27 +-
.../readers/RecordExtractorConfig.java} | 8 +-
.../pinot/spi/data/readers/RecordReader.java | 2 +
.../pinot/spi/data/readers/RecordReaderUtils.java | 178 ++-----
.../pinot/spi/filesystem/PinotFSFactory.java | 11 +-
.../pinot/spi/utils/SchemaFieldExtractorUtils.java | 133 ++++++
.../org/apache/pinot/spi/utils/StringUtils.java | 53 +++
.../org/apache/pinot/spi/utils}/TimeConverter.java | 2 +-
.../spi/utils/builder/TableConfigBuilder.java | 41 +-
.../pinot/spi/utils/builder/TableNameBuilder.java | 2 +-
.../pinot/spi/config/IndexingConfigTest.java | 4 +
.../apache/pinot/spi/config/QuotaConfigTest.java | 2 +
.../apache/pinot/spi/config/api/TenantTest.java | 3 +
.../evaluators/GroovyExpressionEvaluatorTest.java | 87 ++++
.../data/readers/AbstractRecordExtractorTest.java | 149 ++++++
.../spi/data/readers/AbstractRecordReaderTest.java | 2 +-
.../spi/data/readers/RecordReaderUtilsTest.java | 54 +--
.../spi/utils/SchemaFieldExtractorUtilsTest.java | 179 +++++++
.../apache/pinot/spi/utils}/TimeConverterTest.java | 2 +-
.../groovy_map_transform_functions_schema.json | 27 ++
.../groovy_transform_functions_schema.json | 44 ++
pinot-tools/pom.xml | 30 +-
...QuickStart.java => GitHubEventsQuickstart.java} | 121 ++---
.../org/apache/pinot/tools/HybridQuickstart.java | 2 +-
.../apache/pinot/tools/PinotNumReplicaChanger.java | 2 +-
.../apache/pinot/tools/PinotTableRebalancer.java | 6 +-
.../java/org/apache/pinot/tools/Quickstart.java | 2 +-
.../apache/pinot/tools/QuickstartTableRequest.java | 2 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 2 +-
.../org/apache/pinot/tools/UpdateSegmentState.java | 2 +-
.../pinot/tools/admin/PinotAdministrator.java | 8 +-
.../tools/admin/command/AddTenantCommand.java | 4 +-
.../tools/admin/command/CreateSegmentCommand.java | 74 ++-
.../command/GitHubEventsQuickStartCommand.java | 72 +++
.../tools/admin/command/MoveReplicaGroup.java | 2 +-
.../OfflineSegmentIntervalCheckerCommand.java | 2 +-
.../tools/admin/command/QuickstartRunner.java | 4 +-
.../command/RealtimeProvisioningHelperCommand.java | 2 +-
.../tools/admin/command/RebalanceTableCommand.java | 13 +-
.../admin/command/StreamGitHubEventsCommand.java | 111 +++++
.../tools/admin/command/ValidateConfigCommand.java | 2 +-
.../config/validator/TableConfigValidator.java | 2 +-
.../pinot/tools/perf/PerfBenchmarkDriver.java | 8 +-
.../tools/query/comparison/ClusterStarter.java | 4 +-
.../realtime/provisioning/MemoryEstimator.java | 2 +-
.../apache/pinot/tools/scan/query/Aggregation.java | 4 +-
.../tools/scan/query/SegmentQueryProcessor.java | 4 +-
.../segment/converter/SegmentMergeCommand.java | 4 +-
.../streams/githubevents/GitHubAPICaller.java | 205 ++++++++
.../githubevents/PullRequestMergedEvent.java | 370 +++++++++++++++
.../PullRequestMergedEventsStream.java | 307 ++++++++++++
.../batch/airlineStats/sparkIngestionJobSpec.yaml | 4 +-
.../baseballStats_offline_table_config.json | 3 -
.../batch/baseballStats/sparkIngestionJobSpec.yaml | 4 +-
...lRequestMergedEvents_realtime_table_config.json | 36 ++
...lRequestMergedEvents_realtime_table_config.json | 37 ++
.../pullRequestMergedEvents_schema.json | 151 ++++++
pinot-tools/src/main/resources/log4j2.xml | 3 +
pom.xml | 191 +++++++-
.../app/pods/components/alert-details/component.js | 86 +++-
.../app/pods/components/alert-details/template.hbs | 47 +-
.../components/contribution-table/component.js | 211 ---------
.../components/contribution-table/template.hbs | 249 ----------
.../rootcause-dimensions-algorithm/component.js | 24 +-
.../dimensions-table/change-bars/template.hbs | 2 +-
.../pods/custom/dimensions-table/cost/template.hbs | 1 -
.../custom/dimensions-table/dimension/template.hbs | 4 +-
.../{cost => percent-change}/component.js | 0
.../dimensions-table/percent-change/template.hbs | 1 +
.../thirdeye-frontend/app/pods/home/index/route.js | 32 +-
.../app/pods/home/share-dashboard/route.js | 37 +-
.../app/shared/dimensionAnalysisTableConfig.js | 23 +-
thirdeye/thirdeye-frontend/app/styles/app.scss | 2 +-
.../app/styles/components/alert-details.scss | 35 ++
.../app/styles/components/contribution-table.scss | 132 ------
.../app/styles/pods/custom/dimensions-table.scss | 29 +-
.../app/utils/manage-alert-utils.js | 67 ++-
.../contribution-table/component-test.js | 26 --
.../apache/pinot/thirdeye/anomaly/AnomalyType.java | 16 +-
.../anomaly/monitor/MonitorTaskRunner.java | 66 +++
.../thirdeye/anomaly/task/TaskRunnerFactory.java | 4 +-
.../dashboard/ThirdEyeDashboardApplication.java | 2 +-
.../dashboard/ThirdEyeDashboardConfiguration.java | 13 +
.../datalayer/bao/MergedAnomalyResultManager.java | 2 +
.../bao/jdbc/MergedAnomalyResultManagerImpl.java | 11 +-
.../thirdeye/datalayer/dao/GenericPojoDao.java | 4 +
.../pinot/thirdeye/datalayer/dto/AbstractDTO.java | 10 +
.../datalayer/pojo/DetectionConfigBean.java | 14 +-
.../pinot/thirdeye/detection/DataProvider.java | 2 +
.../pinot/thirdeye/detection/DetectionUtils.java | 13 +-
.../apache/pinot/thirdeye/detection/TaskUtils.java | 1 -
.../pinot/thirdeye/detection/alert/AlertUtils.java | 1 +
.../alert/StatefulDetectionAlertFilter.java | 40 +-
.../filter/DimensionsRecipientAlertFilter.java | 2 +-
.../alert/filter/PerUserDimensionAlertFilter.java | 2 +-
.../ToAllRecipientsDetectionAlertFilter.java | 3 +-
.../annotation/registry/DetectionRegistry.java | 7 -
.../availability/DataAvailabilityTaskRunner.java | 85 ----
.../components/ThresholdRuleAnomalyFilter.java | 32 +-
.../detection/datasla/DatasetSlaTaskRunner.java | 320 +++++++++++++
.../thirdeye/detection/health/DetectionHealth.java | 19 +-
.../detection/health/DetectionTaskStatus.java | 15 +-
.../detection/yaml/DetectionConfigTuner.java | 4 +-
.../thirdeye/detection/yaml/YamlResource.java | 22 +-
.../yaml/translator/DetectionConfigTranslator.java | 4 +-
.../formatter/DetectionConfigFormatter.java | 3 -
.../content/BaseNotificationContent.java | 133 +++++-
.../content/templates/EntityGroupKeyContent.java | 14 +-
.../templates/HierarchicalAnomaliesContent.java | 16 +-
.../content/templates/MetricAnomaliesContent.java | 15 +-
.../rootcause/impl/MetricBreakdownPipeline.java | 19 +-
.../thirdeye/scheduler/DetectionCronScheduler.java | 2 +-
.../scheduler/SubscriptionCronScheduler.java | 1 +
.../detector/jira-metric-anomalies-template.ftl | 4 +-
.../detector/metric-anomalies-template.ftl | 6 +-
.../trigger/DataAvailabilityTaskSchedulerTest.java | 5 +-
.../pinot/thirdeye/detection/MockDataProvider.java | 3 +
.../thirdeye/detection/alert/SendAlertTest.java | 2 +
.../detection/alert/filter/AlertFilterUtils.java | 43 ++
.../filter/DimensionsRecipientAlertFilterTest.java | 149 +++---
.../filter/PerUserDimensionAlertFilterTest.java | 74 ++-
.../ToAllRecipientsDetectionAlertFilterTest.java | 257 +++++-----
.../datasla/DatasetSlaTaskRunnerTest.java | 478 +++++++++++++++++++
.../wrapper/EntityAnomalyMergeWrapperTest.java | 13 +-
.../templates/TestMetricAnomaliesContent.java | 58 ++-
.../channels/TestJiraContentFormatter.java | 33 +-
.../tools/RunAdhocDatabaseQueriesTool.java | 104 +++++
.../resources/test-jira-anomalies-template.ftl | 7 +-
.../resources/test-metric-anomalies-template.html | 69 ++-
website/docusaurus.config.js | 5 +-
website/static/img/pinot-navbar-logo.svg | 19 +
534 files changed, 13279 insertions(+), 5659 deletions(-)
delete mode 100644 kubernetes/helm/charts/zookeeper-2.0.0.tgz
create mode 100644 kubernetes/helm/charts/zookeeper-2.1.3.tgz
create mode 100644 kubernetes/helm/pinot-github-events-setup.yml
copy
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/AnomalyType.java
=> pinot-common/src/main/java/org/apache/pinot/parsers/CompilerConstants.java
(70%)
delete mode 100644
pinot-core/src/main/java/org/apache/pinot/core/data/recordtransformer/TimeTransformer.java
delete mode 100644
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/inv/DictionaryBasedRangeIndexCreator.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/inv/RangeIndexCreator.java
rename
pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/{BitmapRangeIndexReader.java
=> RangeIndexReader.java} (52%)
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/data/recordtransformer/ExpressionTransformerTest.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/data/recordtransformer/ExpressionTransformerTimeTest.java
delete mode 100644
pinot-core/src/test/java/org/apache/pinot/core/data/recordtransformer/TimeTransformerTest.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/segment/index/creator/RangeIndexCreatorTest.java
create mode 100644
pinot-core/src/test/resources/data/expression_transformer/groovy_expression_transformer.json
create mode 100644 pinot-core/src/test/resources/data/fixedByteCompressed.v2
create mode 100644 pinot-core/src/test/resources/data/fixedByteRaw.v2
create mode 100644
pinot-core/src/test/resources/data/varByteStringsCompressed.v2
create mode 100644 pinot-core/src/test/resources/data/varByteStringsRaw.v2
create mode 100644
pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkGroovyExpressionEvaluation.java
copy pinot-spi/src/test/java/org/apache/pinot/spi/config/api/TenantTest.java
=>
pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/test/java/org/apache/pinot/plugin/ingestion/batch/common/TestSegmentGenerationUtils.java
(51%)
delete mode 100644
pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/test/java/org/apache/pinot/integration/tests/HadoopSegmentBuildPushOfflineClusterIntegrationTest.java
create mode 100644
pinot-plugins/pinot-file-system/pinot-hdfs/src/test/java/org/apache/pinot/plugin/filesystem/HadoopPinotFSTest.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/pom.xml
create mode 100644
pinot-plugins/pinot-file-system/pinot-s3/src/main/java/org/apache/pinot/plugin/filesystem/S3PinotFS.java
create mode 100644
pinot-plugins/pinot-file-system/pinot-s3/src/test/java/org/apache/pinot/plugin/filesystem/S3PinotFSTest.java
create mode 100644
pinot-plugins/pinot-file-system/pinot-s3/src/test/java/org/apache/pinot/plugin/filesystem/S3TestUtils.java
create mode 100644
pinot-plugins/pinot-file-system/pinot-s3/src/test/resources/copyFile.txt
create mode 100644
pinot-plugins/pinot-file-system/pinot-s3/src/test/resources/log4j2.xml
create mode 100644
pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorMapTypeTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroUtilsTest.java
copy thirdeye/thirdeye-hadoop/src/test/resources/schema.avsc =>
pinot-plugins/pinot-input-format/pinot-avro-base/src/test/resources/fake_avro_schema.avsc
(100%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-csv/src/main/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordExtractor.java
copy
pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/DistinctCountRawHLLMVAggregationFunction.java
=>
pinot-plugins/pinot-input-format/pinot-csv/src/main/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordExtractorConfig.java
(64%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-csv/src/test/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordExtractorTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/JSONRecordExtractor.java
copy
pinot-plugins/pinot-input-format/pinot-json/src/test/java/org/apache/pinot/plugin/inputformat/json/{JSONRecordReaderTest.java
=> JSONRecordExtractorTest.java} (61%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-orc/src/test/java/org/apache/pinot/plugin/inputformat/orc/ORCRecordExtractorTest.java
copy
pinot-plugins/pinot-input-format/{pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractor.java
=>
pinot-parquet/src/main/java/org/apache/pinot/plugin/inputformat/parquet/ParquetRecordExtractor.java}
(50%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-parquet/src/test/java/org/apache/pinot/plugin/inputformat/parquet/ParquetRecordExtractorTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordExtractor.java
copy
pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/DistinctCountRawHLLMVAggregationFunction.java
=>
pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordExtractorConfig.java
(64%)
copy
pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordExtractor.java
=>
pinot-server/src/main/java/org/apache/pinot/server/api/access/AccessControl.java
(59%)
copy pinot-spi/src/main/java/org/apache/pinot/spi/config/TableType.java =>
pinot-server/src/main/java/org/apache/pinot/server/api/access/AccessControlFactory.java
(73%)
copy
pinot-controller/src/main/java/org/apache/pinot/controller/api/events/DefaultMetadataEventNotifier.java
=>
pinot-server/src/main/java/org/apache/pinot/server/api/access/AllowAllAccessFactory.java
(65%)
create mode 100644
pinot-server/src/test/java/org/apache/pinot/server/api/AccessControlTest.java
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{api =>
instance}/Instance.java (98%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{api =>
instance}/InstanceType.java (95%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/ColumnPartitionConfig.java (95%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/CompletionConfig.java (94%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/FieldConfig.java (80%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/IndexingConfig.java (98%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/QueryConfig.java (95%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/QuotaConfig.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/ReplicaGroupStrategyConfig.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/RoutingConfig.java (95%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/SegmentPartitionConfig.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/SegmentsValidationAndRetentionConfig.java (97%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/StarTreeIndexConfig.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/TableConfig.java (97%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/TableCustomConfig.java (93%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/TableTaskConfig.java (94%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/TableType.java (95%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/TagOverrideConfig.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/TenantConfig.java (95%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/assignment/InstanceAssignmentConfig.java (98%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/assignment/InstanceConstraintConfig.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/assignment/InstancePartitionsType.java (96%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/assignment/InstanceReplicaGroupPartitionConfig.java (98%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{ =>
table}/assignment/InstanceTagPoolConfig.java (97%)
rename pinot-spi/src/main/java/org/apache/pinot/spi/config/{api =>
tenant}/Tenant.java (98%)
copy pinot-spi/src/main/java/org/apache/pinot/spi/config/{api =>
tenant}/TenantRole.java (95%)
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/data/function/evaluators/DefaultTimeSpecEvaluator.java
copy
pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractor.java
=>
pinot-spi/src/main/java/org/apache/pinot/spi/data/function/evaluators/ExpressionEvaluator.java
(56%)
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/data/function/evaluators/ExpressionEvaluatorFactory.java
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/data/function/evaluators/GroovyExpressionEvaluator.java
delete mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/AbstractBaseRecordExtractor.java
rename
pinot-spi/src/main/java/org/apache/pinot/spi/{config/api/TenantRole.java =>
data/readers/RecordExtractorConfig.java} (84%)
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/utils/SchemaFieldExtractorUtils.java
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/utils/StringUtils.java
rename {pinot-common/src/main/java/org/apache/pinot/common/utils/time =>
pinot-spi/src/main/java/org/apache/pinot/spi/utils}/TimeConverter.java (98%)
create mode 100644
pinot-spi/src/test/java/org/apache/pinot/spi/data/function/evaluators/GroovyExpressionEvaluatorTest.java
create mode 100644
pinot-spi/src/test/java/org/apache/pinot/spi/data/readers/AbstractRecordExtractorTest.java
create mode 100644
pinot-spi/src/test/java/org/apache/pinot/spi/utils/SchemaFieldExtractorUtilsTest.java
rename {pinot-common/src/test/java/org/apache/pinot/common/utils/time =>
pinot-spi/src/test/java/org/apache/pinot/spi/utils}/TimeConverterTest.java (99%)
create mode 100644
pinot-spi/src/test/resources/groovy_map_transform_functions_schema.json
create mode 100644
pinot-spi/src/test/resources/groovy_transform_functions_schema.json
copy pinot-tools/src/main/java/org/apache/pinot/tools/{RealtimeQuickStart.java
=> GitHubEventsQuickstart.java} (50%)
create mode 100644
pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/GitHubEventsQuickStartCommand.java
create mode 100644
pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/StreamGitHubEventsCommand.java
create mode 100644
pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/GitHubAPICaller.java
create mode 100644
pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/PullRequestMergedEvent.java
create mode 100644
pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/PullRequestMergedEventsStream.java
create mode 100644
pinot-tools/src/main/resources/examples/stream/githubEvents/docker/pullRequestMergedEvents_realtime_table_config.json
create mode 100644
pinot-tools/src/main/resources/examples/stream/githubEvents/pullRequestMergedEvents_realtime_table_config.json
create mode 100644
pinot-tools/src/main/resources/examples/stream/githubEvents/pullRequestMergedEvents_schema.json
delete mode 100644
thirdeye/thirdeye-frontend/app/pods/components/contribution-table/component.js
delete mode 100644
thirdeye/thirdeye-frontend/app/pods/components/contribution-table/template.hbs
delete mode 100644
thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/cost/template.hbs
rename thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/{cost =>
percent-change}/component.js (100%)
create mode 100644
thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/percent-change/template.hbs
create mode 100644
thirdeye/thirdeye-frontend/app/styles/components/alert-details.scss
delete mode 100644
thirdeye/thirdeye-frontend/app/styles/components/contribution-table.scss
delete mode 100644
thirdeye/thirdeye-frontend/tests/integration/pods/components/contribution-table/component-test.js
delete mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/availability/DataAvailabilityTaskRunner.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/datasla/DatasetSlaTaskRunner.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/datasla/DatasetSlaTaskRunnerTest.java
create mode 100644 website/static/img/pinot-navbar-logo.svg
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
