This is an automated email from the ASF dual-hosted git repository.
jackie pushed a change to branch helix_091_release_branch
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard d8418b8 For internal release purposes, upgrade helix to 0.9.1
add 57f67c9 Refactor segments admin rest APIs (#4806)
add 75dbe8c Enhance RoutingTable with ServerInstance (#4823)
add 687ac69 Reorg k8s related scripts structure and update readme (#4827)
add 85c7f5a Add segment batch deletion rest API (#4828)
add c33da6b [TE] change default time zone to pacific time zone (#4830)
add d493707 Add user guide for pluggable storage for realtime table
(#4783)
add 54a4991 Misc enhancements to the broker routing (#4831)
add 3c00da7 [TE][notification] Jira Alerting improvements (#4829)
add 12dd36c [TE] fix mismatch in dataset names in data availability
listener (#4832)
add a9f6591 Replace NettyTCPServer with QueryServer for server side query
handling (#4834)
add 2189c92 Adding example of pinot-quickstart with Avro encoded messages
in Kafka (#4836)
add 2f203df Support ORDER BY for DISTINCT queries (#4790)
add 8763494 Fix documentation on LLC configs (#4839)
add e189f5e Refactoring realtime segment committer (#4713)
add 94f687a Handle default value after adding new byte column (#4844)
add 81703be [TE] Centralized cache proof-of-concept for anomaly detection
via Couchbase (#4761)
add c720b99 [TE] quick fix for error in retriving legacy anomaly (#4843)
add 5e5b32f Remove the support of Hocon based config (#4841)
add 9403cf1 Remove the redundant testSqlQueriesFromQueryFile() in
integration tests (#4848)
add e1b3512 Prepare for pinot release 0.3.0 (#4849)
add e6e7bf9 [TE] Use default centralized cache settings if exception
occurs during init (#4845)
add 1cc296b [TE] Fix duplicate entries in entity report (#4840)
add 759eee9 Add getFinalResultColumnType to be used in constructing
ResultTable::dataSchema (#4852)
add dada6e2 [TE] Minor fix on DataAvailabilityTaskScheduler (#4853)
add 2f18f65 [TE] add detection health for the alerts list (#4842)
add 0f64e4a Fixing encryption for .tar.gz upload (#4855)
add 98f8c9a [TE] Update AI Availability dashboard to v2 (#4857)
add c0f8b7a Fix the controller rest API for non local FS. (#4808)
add 5c02b14 Split BrokerReduceService code into several DataTableReducers
(#4851)
new cf7d677 For internal release purposes, upgrade helix to 0.9.1
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d8418b8)
\
N -- N -- N refs/heads/helix_091_release_branch (cf7d677)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 5 +
docs/code_modules.rst | 4 +-
docs/dev_env.rst | 2 +-
docs/pluggable_storage.rst | 33 +-
docs/pluggable_streams.rst | 18 +-
docs/pql_examples.rst | 4 +-
docs/tableconfig_schema.rst | 5 +-
kubernetes/README.md | 8 +-
kubernetes/{examples => }/helm/Chart.yaml | 0
kubernetes/{examples => }/helm/README.md | 35 +-
kubernetes/helm/charts/zookeeper-2.0.0.tgz | Bin 0 -> 10633 bytes
kubernetes/{examples => }/helm/helm-rbac.yaml | 0
kubernetes/{examples => }/helm/open-superset-ui.sh | 0
kubernetes/{examples => }/helm/pinot-presto-cli.sh | 0
.../helm/pinot-realtime-quickstart.yml | 69 +-
.../{examples => }/helm/presto-coordinator.yaml | 0
.../skaffold/gke => helm}/query-pinot-data.sh | 0
kubernetes/{examples => }/helm/requirements.lock | 0
kubernetes/{examples => }/helm/requirements.yaml | 0
kubernetes/{examples => }/helm/setup_gke.sh | 0
kubernetes/{examples => }/helm/superset.yaml | 0
.../{examples => }/helm/templates/_helpers.tpl | 0
.../helm/templates/broker/configmap.yaml | 0
.../helm/templates/broker/service-external.yaml | 0
.../helm/templates/broker/service-headless.yaml | 0
.../helm/templates/broker/service.yaml | 0
.../helm/templates/broker/statefulset.yml | 0
.../helm/templates/controller/configmap.yaml | 0
.../templates/controller/service-external.yaml | 0
.../templates/controller/service-headless.yaml | 0
.../helm/templates/controller/service.yaml | 0
.../helm/templates/controller/statefulset.yaml | 0
.../helm/templates/server/configmap.yaml | 0
.../helm/templates/server/service-headless.yaml | 0
.../helm/templates/server/service.yaml | 0
.../helm/templates/server/statefulset.yml | 0
kubernetes/{examples => }/helm/values.yaml | 0
kubernetes/{examples => }/skaffold/gke/README.md | 0
kubernetes/{examples => }/skaffold/gke/cleanup.sh | 0
.../skaffold/gke/gke-storageclass-kafka-pd.yml | 0
.../gke/gke-storageclass-pinot-controller-pd.yml | 0
.../gke/gke-storageclass-pinot-server-pd.yml | 0
.../skaffold/gke/gke-storageclass-zk-pd.yml | 0
kubernetes/{examples => }/skaffold/gke/kafka.yml | 0
.../{examples => }/skaffold/gke/pinot-broker.yml | 0
.../skaffold/gke/pinot-controller.yml | 0
.../skaffold/gke/pinot-realtime-quickstart.yml | 0
.../{examples => }/skaffold/gke/pinot-server.yml | 0
.../helm => skaffold/gke}/query-pinot-data.sh | 0
kubernetes/{examples => }/skaffold/gke/setup.sh | 0
.../{examples => }/skaffold/gke/skaffold.yaml | 0
.../{examples => }/skaffold/gke/zookeeper.yml | 0
pinot-api/pom.xml | 2 +-
pinot-azure-filesystem/pom.xml | 2 +-
pinot-broker/pom.xml | 2 +-
.../requesthandler/BaseBrokerRequestHandler.java | 39 +-
.../ConnectionPoolBrokerRequestHandler.java | 30 +-
.../SingleConnectionBrokerRequestHandler.java | 5 +-
.../routing/HelixExternalViewBasedRouting.java | 24 +-
.../apache/pinot/broker/routing/RoutingTable.java | 22 +-
.../builder/BalancedRandomRoutingTableBuilder.java | 18 +-
.../BasePartitionAwareRoutingTableBuilder.java | 24 +-
.../routing/builder/BaseRoutingTableBuilder.java | 88 +--
.../builder/DefaultOfflineRoutingTableBuilder.java | 6 +-
.../DefaultRealtimeRoutingTableBuilder.java | 6 +-
.../builder/GeneratorBasedRoutingTableBuilder.java | 68 +-
.../HighLevelConsumerBasedRoutingTableBuilder.java | 57 +-
...tancePruner.java => InstanceConfigManager.java} | 50 +-
.../LowLevelConsumerRoutingTableBuilder.java | 46 +-
.../PartitionAwareOfflineRoutingTableBuilder.java | 48 +-
.../PartitionAwareRealtimeRoutingTableBuilder.java | 55 +-
.../routing/builder/RoutingTableBuilder.java | 5 +-
.../broker/broker/HelixBrokerStarterTest.java | 3 +-
.../broker/requesthandler/QueryValidationTest.java | 7 +-
.../broker/routing/RandomRoutingTableTest.java | 4 +-
.../pinot/broker/routing/RoutingTableTest.java | 5 +-
.../BalancedRandomRoutingTableBuilderTest.java | 11 +-
.../HighLevelConsumerRoutingTableBuilderTest.java | 3 +-
.../LargeClusterRoutingTableBuilderTest.java | 53 +-
.../LowLevelConsumerRoutingTableBuilderTest.java | 17 +-
...rtitionAwareOfflineRoutingTableBuilderTest.java | 11 +-
...titionAwareRealtimeRoutingTableBuilderTest.java | 9 +-
pinot-common/pom.xml | 10 +-
.../config/AdjustTableNameChildKeyTransformer.java | 70 --
.../pinot/common/config/ChildKeyHandler.java | 45 --
.../pinot/common/config/ChildKeyTransformer.java | 33 -
.../pinot/common/config/ColumnPartitionConfig.java | 16 +-
.../config/ColumnPartitionMapChildKeyHandler.java | 28 -
.../apache/pinot/common/config/CombinedConfig.java | 110 ----
.../pinot/common/config/CombinedConfigLoader.java | 171 -----
...CombinedConfigSeparatorChildKeyTransformer.java | 132 ----
.../pinot/common/config/CompletionConfig.java | 4 +-
.../org/apache/pinot/common/config/ConfigKey.java | 31 -
.../apache/pinot/common/config/Deserializer.java | 445 -------------
.../org/apache/pinot/common/config/Duration.java | 77 ---
.../apache/pinot/common/config/DurationDsl.java | 57 --
.../apache/pinot/common/config/IndexingConfig.java | 40 +-
.../common/config/NamedListChildKeyHandler.java | 75 ---
.../apache/pinot/common/config/NestedConfig.java | 31 -
.../pinot/common/config/PinotTaskConfig.java | 11 +-
.../apache/pinot/common/config/QuotaConfig.java | 5 +-
.../config/RemapTableTypesChildKeyTransformer.java | 64 --
.../common/config/ReplicaGroupStrategyConfig.java | 6 -
.../apache/pinot/common/config/RoutingConfig.java | 2 -
.../common/config/SegmentPartitionConfig.java | 14 +-
.../SegmentsValidationAndRetentionConfig.java | 26 -
.../org/apache/pinot/common/config/Serializer.java | 197 ------
.../common/config/SimpleMapChildKeyHandler.java | 50 --
.../apache/pinot/common/config/SingleKeyDsl.java | 30 -
.../pinot/common/config/StarTreeIndexConfig.java | 7 -
.../apache/pinot/common/config/TableConfig.java | 26 +-
.../pinot/common/config/TableCustomConfig.java | 2 -
.../pinot/common/config/TableTaskConfig.java | 3 -
.../pinot/common/config/TagOverrideConfig.java | 31 +-
.../config/TaskConfigMapChildKeyHandler.java | 59 --
.../org/apache/pinot/common/config/Tenant.java | 21 +-
.../apache/pinot/common/config/TenantConfig.java | 34 +-
.../common/config/TypedMapChildKeyHandler.java | 74 ---
.../pinot/common/config/UseChildKeyHandler.java | 31 -
.../common/config/UseChildKeyTransformers.java | 34 -
.../org/apache/pinot/common/config/UseDsl.java | 35 -
.../config/instance/InstanceAssignmentConfig.java | 16 +-
...InstanceAssignmentConfigMapChildKeyHandler.java | 28 -
.../config/instance/InstanceConstraintConfig.java | 6 +-
.../InstanceReplicaGroupPartitionConfig.java | 21 +-
.../config/instance/InstanceTagPoolConfig.java | 15 +-
.../pinot/common/data/DateTimeFieldSpec.java | 16 +-
.../data/DateTimeFieldSpecChildKeyHandler.java | 31 -
.../data/DimensionFieldSpecChildKeyHandler.java | 31 -
.../org/apache/pinot/common/data/FieldSpec.java | 24 +-
.../apache/pinot/common/data/MetricFieldSpec.java | 25 +-
.../data/MetricFieldSpecChildKeyHandler.java | 31 -
.../java/org/apache/pinot/common/data/Schema.java | 141 ++--
.../pinot/common/data/StarTreeIndexSpec.java | 7 -
.../apache/pinot/common/data/TimeFieldSpec.java | 69 +-
.../pinot/common/data/TimeGranularitySpec.java | 34 +-
.../apache/pinot/common/metrics/ServerMeter.java | 8 +-
.../apache/pinot/common/metrics/ServerTimer.java | 7 +-
.../protocols/SegmentCompletionProtocol.java | 13 +
.../org/apache/pinot/common/utils/SegmentName.java | 39 +-
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 8 -
.../org/apache/pinot/startree/hll/HllConfig.java | 82 +--
.../common/config/TestConfigSerialization.java | 70 --
.../pinot/common/utils/SegmentNameBuilderTest.java | 9 +-
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 10 -
.../src/test/resources/test-table-config.conf | 32 -
pinot-connectors/pinot-connector-kafka-0.9/pom.xml | 2 +-
pinot-connectors/pinot-connector-kafka-2.0/pom.xml | 4 +-
.../pinot-connector-kafka-base/pom.xml | 2 +-
pinot-connectors/pom.xml | 4 +-
pinot-controller/pom.xml | 2 +-
.../pinot/controller/api/resources/Constants.java | 6 +-
.../resources/LLCSegmentCompletionHandlers.java | 2 +-
.../api/resources/PinotSchemaRestletResource.java | 2 +-
.../api/resources/PinotSegmentRestletResource.java | 707 ++++++++++-----------
...PinotSegmentUploadDownloadRestletResource.java} | 177 ++----
.../resources/PinotTableConfigRestletResource.java | 195 ------
.../helix/ControllerRequestURLBuilder.java | 17 -
.../helix/core/PinotHelixResourceManager.java | 64 +-
pinot-core/pom.xml | 2 +-
.../manager/realtime/DefaultSegmentCommitter.java | 53 ++
.../realtime/LLRealtimeSegmentDataManager.java | 99 +--
.../data/manager/realtime/SegmentCommitter.java | 22 +-
.../manager/realtime/SegmentCommitterFactory.java | 49 ++
.../manager/realtime/SplitSegmentCommitter.java | 84 +++
.../apache/pinot/core/data/table/BaseTable.java | 21 +-
.../org/apache/pinot/core/data/table/Record.java | 11 +
.../apache/pinot/core/data/table/TableResizer.java | 188 +++++-
.../core/query/aggregation/DistinctTable.java | 254 ++++----
.../aggregation/function/AggregationFunction.java | 6 +
.../function/AggregationFunctionFactory.java | 2 +-
.../function/AvgAggregationFunction.java | 5 +
.../function/CountAggregationFunction.java | 5 +
.../function/DistinctAggregationFunction.java | 72 ++-
.../function/DistinctCountAggregationFunction.java | 5 +
.../DistinctCountHLLAggregationFunction.java | 5 +
.../DistinctCountRawHLLAggregationFunction.java | 5 +
.../function/FastHLLAggregationFunction.java | 5 +
.../function/MaxAggregationFunction.java | 5 +
.../function/MinAggregationFunction.java | 5 +
.../function/MinMaxRangeAggregationFunction.java | 5 +
.../function/PercentileAggregationFunction.java | 5 +
.../function/PercentileEstAggregationFunction.java | 5 +
.../PercentileTDigestAggregationFunction.java | 5 +
.../function/SumAggregationFunction.java | 5 +
.../query/reduce/AggregationDataTableReducer.java | 109 ++++
.../core/query/reduce/BrokerReduceService.java | 603 +-----------------
.../pinot/core/query/reduce/DataTableReducer.java | 45 ++
.../query/reduce/DistinctDataTableReducer.java | 132 ++++
.../core/query/reduce/GroupByDataTableReducer.java | 438 +++++++++++++
.../core/query/reduce/ResultReducerFactory.java | 60 ++
.../query/reduce/SelectionDataTableReducer.java | 136 ++++
.../defaultcolumn/BaseDefaultColumnHandler.java | 11 +-
.../pinot/core/transport/AsyncQueryResponse.java | 4 +-
.../pinot/core/transport/DataTableHandler.java | 8 +-
.../core/transport/InstanceRequestHandler.java | 124 ++++
.../apache/pinot/core/transport/QueryRouter.java | 16 +-
.../apache/pinot/core/transport/QueryServer.java} | 41 +-
.../pinot/core/transport/ServerChannels.java | 6 +-
.../pinot/core/transport/ServerInstance.java | 98 +++
.../pinot/core/transport/ServerResponse.java | 24 +-
.../core/transport/ServerRoutingInstance.java | 12 -
.../realtime/LLRealtimeSegmentDataManagerTest.java | 6 +-
.../pinot/core/data/readers/PinotSegmentUtil.java | 4 +-
.../pinot/core/data/table/TableResizerTest.java | 160 +++++
.../core/segment/index/loader/LoaderTest.java | 18 +
...{QueryRouterTest.java => QueryRoutingTest.java} | 164 +++--
.../apache/pinot/queries/DistinctQueriesTest.java | 393 +++++++++---
...erSegmentAggregationSingleValueQueriesTest.java | 53 +-
pinot-distribution/pom.xml | 2 +-
pinot-hadoop-filesystem/pom.xml | 2 +-
pinot-hadoop/pom.xml | 2 +-
pinot-integration-tests/pom.xml | 6 +-
.../tests/BaseClusterIntegrationTest.java | 40 +-
.../tests/BaseClusterIntegrationTestSet.java | 23 +-
.../pinot/integration/tests/ClusterTest.java | 52 +-
.../ControllerPeriodicTasksIntegrationTests.java | 13 +-
...vertToRawIndexMinionClusterIntegrationTest.java | 5 -
.../DefaultCommitterRealtimeIntegrationTest.java | 192 ++++++
.../DeleteAPIHybridClusterIntegrationTest.java | 320 ----------
...mentBuildPushOfflineClusterIntegrationTest.java | 7 -
.../tests/HybridClusterIntegrationTest.java | 14 -
.../tests/LLCRealtimeClusterIntegrationTest.java | 13 +-
.../MultiNodesOfflineClusterIntegrationTest.java | 7 -
.../tests/NewConfigApplyIntegrationTest.java | 116 ----
.../tests/OfflineClusterIntegrationTest.java | 20 -
.../tests/RealtimeClusterIntegrationTest.java | 15 -
.../src/test/resources/mytable-updated.conf | 16 -
.../src/test/resources/mytable.conf | 16 -
.../src/test/resources/profiles/test1.conf | 1 -
.../src/test/resources/profiles/test2.conf | 1 -
pinot-minion/pom.xml | 2 +-
pinot-orc/pom.xml | 2 +-
pinot-parquet/pom.xml | 2 +-
pinot-perf/pom.xml | 2 +-
pinot-server/pom.xml | 2 +-
.../server/api/resources/SchedulerResource.java | 48 --
.../pinot/server/starter/ServerInstance.java | 40 +-
pinot-tools/pom.xml | 2 +-
.../pinot/tools/admin/PinotAdministrator.java | 2 -
.../tools/admin/command/AddSchemaCommand.java | 4 +-
.../pinot/tools/admin/command/AddTableCommand.java | 5 +-
.../admin/command/ApplyTableConfigCommand.java | 150 -----
.../admin/command/StreamAvroIntoKafkaCommand.java | 28 +-
.../manager/collector/CompressedFilePathIter.java | 58 +-
.../pinot/tools/tuner/strategy/FrequencyImpl.java | 40 +-
.../tools/tuner/strategy/ParserBasedImpl.java | 95 ++-
.../strategy/QuantileAnalysisAccumulator.java | 19 +-
.../tools/tuner/strategy/QuantileAnalysisImpl.java | 72 ++-
pinot-transport/pom.xml | 2 +-
pom.xml | 13 +-
.../app/pods/manage/alerts/index/route.js | 6 +-
.../thirdeye-frontend/app/utils/api/anomaly.js | 2 +-
.../thirdeye-frontend/app/utils/api/self-serve.js | 2 +-
.../config/data-sources/cache-config.yml | 20 +
thirdeye/thirdeye-pinot/pom.xml | 6 +
.../trigger/DataAvailabilityEventListener.java | 24 +-
.../DataAvailabilityEventListenerDriver.java | 6 +-
.../trigger/DataAvailabilityTaskScheduler.java | 4 +-
.../DataAvailabilitySchedulingConfiguration.java | 4 +-
.../trigger/utils/DatasetTriggerInfoRepo.java | 2 +-
.../anomaly/monitor/MonitorTaskRunner.java | 31 +
.../anomaly/utils/ThirdeyeMetricsUtil.java | 9 +
.../api/user/dashboard/UserDashboardResource.java | 11 +-
.../thirdeye/common/ThirdEyeConfiguration.java | 18 +-
.../dashboard/ThirdEyeDashboardApplication.java | 2 +-
.../dashboard/resources/v2/AnomaliesResource.java | 2 +-
.../datalayer/pojo/DetectionConfigBean.java | 11 +
.../datasource/RelationalThirdEyeResponse.java | 3 +
.../thirdeye/datasource/ThirdEyeCacheRegistry.java | 55 +-
.../datasource/loader/DefaultTimeSeriesLoader.java | 20 +-
.../pinot/resultset/ThirdEyeResultSetUtils.java | 13 +-
.../datasource/sql/SqlResponseCacheLoader.java | 2 -
.../thirdeye/detection/DefaultDataProvider.java | 85 +--
.../detection/DetectionPipelineTaskRunner.java | 2 +-
.../thirdeye/detection/DetectionResource.java | 42 +-
.../detection/alert/DetectionAlertTaskFactory.java | 2 +-
.../alert/scheme/DetectionEmailAlerter.java | 2 +-
.../alert/scheme/DetectionJiraAlerter.java | 6 +-
.../detection/algorithm/DimensionWrapper.java | 19 +
.../thirdeye/detection/cache/CacheConfig.java | 73 +++
.../detection/cache/CacheConfigLoader.java | 51 ++
.../thirdeye/detection/cache/CacheConstants.java | 31 +-
.../thirdeye/detection/cache/CacheDataSource.java | 48 ++
.../detection/cache/CentralizedCacheConfig.java | 69 ++
.../detection/cache/CouchbaseCacheDAO.java | 159 +++++
.../detection/cache/DefaultTimeSeriesCache.java | 197 ++++++
.../detection/cache/ThirdEyeCacheRequest.java | 64 ++
.../detection/cache/ThirdEyeCacheResponse.java | 181 ++++++
.../thirdeye/detection/cache/TimeSeriesCache.java | 49 ++
.../detection/cache/TimeSeriesDataPoint.java | 104 +++
.../finetune/GridSearchTuningAlgorithm.java | 2 +-
.../thirdeye/detection/health/DetectionHealth.java | 25 +
.../onboard/YamlOnboardingTaskRunner.java | 2 +-
.../spec/AbsoluteChangeRuleAnomalyFilterSpec.java | 2 +-
.../spec/AbsoluteChangeRuleDetectorSpec.java | 2 +-
.../thirdeye/detection/spec/AbstractSpec.java | 1 +
.../PercentageChangeRuleAnomalyFilterSpec.java | 2 +-
.../spec/PercentageChangeRuleDetectorSpec.java | 2 +-
.../detection/spec/RuleBaselineProviderSpec.java | 2 +-
.../spec/SitewideImpactRuleAnomalyFilterSpec.java | 2 +-
.../detection/wrapper/AnomalyDetectorWrapper.java | 38 +-
.../thirdeye/detection/yaml/YamlResource.java | 55 +-
.../formatter/DetectionAlertConfigFormatter.java | 2 +
.../formatter/DetectionConfigFormatter.java | 26 +-
.../thirdeye/notification/commons/JiraEntity.java | 26 +-
.../notification/commons/ThirdEyeJiraClient.java | 114 +++-
.../content/templates/EntityGroupKeyContent.java | 8 +-
.../formatter/channels/JiraContentFormatter.java | 22 +-
.../org/apache/pinot/thirdeye/util/CacheUtils.java | 89 +++
.../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 21 +
.../detector/jira-metric-anomalies-template.ftl | 2 +-
.../trigger/DataAvailabilityEventListenerTest.java | 32 +-
.../trigger/DatasetTriggerInfoRepoTest.java | 16 +-
.../trigger/MockConsumerDataAvailability.java | 2 +
.../csv/CSVThirdEyeDataSourceIntegrationTest.java | 1 +
.../MockThirdEyeDataSourceIntegrationTest.java | 1 +
.../pinot/thirdeye/detection/DataProviderTest.java | 2 +-
.../detection/DetectionPipelineTaskRunnerTest.java | 3 +
.../detection/cache/ThirdEyeCacheResponseTest.java | 337 ++++++++++
.../detection/cache/TimeSeriesCacheTest.java | 310 +++++++++
.../PercentageChangeRuleDetectorTest.java | 1 +
.../integration/NotificationTaskSchedulerTest.java | 2 +-
.../commons/TestThirdEyeJiraClient.java | 61 ++
.../templates/TestMetricAnomaliesContent.java | 2 +-
.../channels/TestJiraContentFormatter.java | 1 +
.../apache/pinot/thirdeye/util/CacheUtilTest.java | 104 +++
.../test/resources/data-sources/cache-config.yml | 23 +
.../notification/commons/jira_create_schema.json | 85 +++
.../resources/test-jira-anomalies-template.ftl | 2 +-
330 files changed, 6686 insertions(+), 6242 deletions(-)
rename kubernetes/{examples => }/helm/Chart.yaml (100%)
rename kubernetes/{examples => }/helm/README.md (98%)
create mode 100644 kubernetes/helm/charts/zookeeper-2.0.0.tgz
rename kubernetes/{examples => }/helm/helm-rbac.yaml (100%)
rename kubernetes/{examples => }/helm/open-superset-ui.sh (100%)
rename kubernetes/{examples => }/helm/pinot-presto-cli.sh (100%)
rename kubernetes/{examples => }/helm/pinot-realtime-quickstart.yml (61%)
rename kubernetes/{examples => }/helm/presto-coordinator.yaml (100%)
rename kubernetes/{examples/skaffold/gke => helm}/query-pinot-data.sh (100%)
rename kubernetes/{examples => }/helm/requirements.lock (100%)
rename kubernetes/{examples => }/helm/requirements.yaml (100%)
rename kubernetes/{examples => }/helm/setup_gke.sh (100%)
rename kubernetes/{examples => }/helm/superset.yaml (100%)
rename kubernetes/{examples => }/helm/templates/_helpers.tpl (100%)
rename kubernetes/{examples => }/helm/templates/broker/configmap.yaml (100%)
rename kubernetes/{examples => }/helm/templates/broker/service-external.yaml
(100%)
rename kubernetes/{examples => }/helm/templates/broker/service-headless.yaml
(100%)
rename kubernetes/{examples => }/helm/templates/broker/service.yaml (100%)
rename kubernetes/{examples => }/helm/templates/broker/statefulset.yml (100%)
rename kubernetes/{examples => }/helm/templates/controller/configmap.yaml
(100%)
rename kubernetes/{examples =>
}/helm/templates/controller/service-external.yaml (100%)
rename kubernetes/{examples =>
}/helm/templates/controller/service-headless.yaml (100%)
rename kubernetes/{examples => }/helm/templates/controller/service.yaml (100%)
rename kubernetes/{examples => }/helm/templates/controller/statefulset.yaml
(100%)
rename kubernetes/{examples => }/helm/templates/server/configmap.yaml (100%)
rename kubernetes/{examples => }/helm/templates/server/service-headless.yaml
(100%)
rename kubernetes/{examples => }/helm/templates/server/service.yaml (100%)
rename kubernetes/{examples => }/helm/templates/server/statefulset.yml (100%)
rename kubernetes/{examples => }/helm/values.yaml (100%)
rename kubernetes/{examples => }/skaffold/gke/README.md (100%)
rename kubernetes/{examples => }/skaffold/gke/cleanup.sh (100%)
rename kubernetes/{examples => }/skaffold/gke/gke-storageclass-kafka-pd.yml
(100%)
rename kubernetes/{examples =>
}/skaffold/gke/gke-storageclass-pinot-controller-pd.yml (100%)
rename kubernetes/{examples =>
}/skaffold/gke/gke-storageclass-pinot-server-pd.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/gke-storageclass-zk-pd.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/kafka.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-broker.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-controller.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-realtime-quickstart.yml
(100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-server.yml (100%)
rename kubernetes/{examples/helm => skaffold/gke}/query-pinot-data.sh (100%)
rename kubernetes/{examples => }/skaffold/gke/setup.sh (100%)
rename kubernetes/{examples => }/skaffold/gke/skaffold.yaml (100%)
rename kubernetes/{examples => }/skaffold/gke/zookeeper.yml (100%)
rename
pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/{RoutingTableInstancePruner.java
=> InstanceConfigManager.java} (52%)
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/AdjustTableNameChildKeyTransformer.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/ChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/ChildKeyTransformer.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/ColumnPartitionMapChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/CombinedConfig.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/CombinedConfigLoader.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/CombinedConfigSeparatorChildKeyTransformer.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/ConfigKey.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/Deserializer.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/Duration.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/DurationDsl.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/NamedListChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/NestedConfig.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/RemapTableTypesChildKeyTransformer.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/Serializer.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/SimpleMapChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/SingleKeyDsl.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/TaskConfigMapChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/TypedMapChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/UseChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/UseChildKeyTransformers.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/UseDsl.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceAssignmentConfigMapChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeFieldSpecChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/data/DimensionFieldSpecChildKeyHandler.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/data/MetricFieldSpecChildKeyHandler.java
delete mode 100644
pinot-common/src/test/java/org/apache/pinot/common/config/TestConfigSerialization.java
delete mode 100644 pinot-common/src/test/resources/test-table-config.conf
rename
pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/{PinotSegmentUploadRestletResource.java
=> PinotSegmentUploadDownloadRestletResource.java} (77%)
delete mode 100644
pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableConfigRestletResource.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/DefaultSegmentCommitter.java
rename
pinot-common/src/main/java/org/apache/pinot/common/config/ConfigNodeLifecycleAware.java
=>
pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SegmentCommitter.java
(57%)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SegmentCommitterFactory.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SplitSegmentCommitter.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/AggregationDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/DataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/DistinctDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/GroupByDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/ResultReducerFactory.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/SelectionDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/transport/InstanceRequestHandler.java
rename
pinot-core/src/{test/java/org/apache/pinot/core/transport/DummyServer.java =>
main/java/org/apache/pinot/core/transport/QueryServer.java} (69%)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/transport/ServerInstance.java
rename
pinot-core/src/test/java/org/apache/pinot/core/transport/{QueryRouterTest.java
=> QueryRoutingTest.java} (54%)
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/DefaultCommitterRealtimeIntegrationTest.java
delete mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/DeleteAPIHybridClusterIntegrationTest.java
delete mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/NewConfigApplyIntegrationTest.java
delete mode 100644
pinot-integration-tests/src/test/resources/mytable-updated.conf
delete mode 100644 pinot-integration-tests/src/test/resources/mytable.conf
delete mode 100644
pinot-integration-tests/src/test/resources/profiles/test1.conf
delete mode 100644
pinot-integration-tests/src/test/resources/profiles/test2.conf
delete mode 100644
pinot-server/src/main/java/org/apache/pinot/server/api/resources/SchedulerResource.java
delete mode 100644
pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/ApplyTableConfigCommand.java
create mode 100644 thirdeye/thirdeye-pinot/config/data-sources/cache-config.yml
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheConfig.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheConfigLoader.java
rename
pinot-common/src/main/java/org/apache/pinot/common/config/ConfigDoc.java =>
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheConstants.java
(52%)
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheDataSource.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CentralizedCacheConfig.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CouchbaseCacheDAO.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/DefaultTimeSeriesCache.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/ThirdEyeCacheRequest.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/ThirdEyeCacheResponse.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/TimeSeriesCache.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/TimeSeriesDataPoint.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/util/CacheUtils.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/cache/ThirdEyeCacheResponseTest.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/cache/TimeSeriesCacheTest.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/commons/TestThirdEyeJiraClient.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/util/CacheUtilTest.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/resources/data-sources/cache-config.yml
create mode 100644
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/notification/commons/jira_create_schema.json
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
