This is an automated email from the ASF dual-hosted git repository.
jihao pushed a change to branch severity-alerter
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard c95c341 address comments
discard 5511721 refactor
discard f614acb severity alerter & unit tests
discard 8bc3d48 add anomaly notification table
add be27d52 [TE][bug] Treat ThirdEye alert creation as a transaction
(#5958)
add 5139a6a Add port to swagger ui (#5959)
add d902c1a Removing node_modules from source tarball (#5963)
add 7f12105 [Deepstore by-pass]Add a Deepstore bypass integration test
with minor bug fixes. (#5857)
add f3ed95c Add compatibility verifier scripts (#4854) (#5911)
add 4c20bb5 [TE] Added helm deployment for ThirdEye (#5961)
add 8a31bf7 Add Hadoop counters for detecting schema mismatch (#5873)
add 2dbc94c [TE] only merge same trend in ChildKeepingMerge (#5920)
add c8db558 [TE] Protect against Infinity and NaN values in RCA time
series response (#5943)
add 1e17f6d [TE] add lastTimestamp into the detection schema (#5964)
add 8496317 Set localhost as the base url in
ControllerAdminApiApplication (#5969)
add 023003a [TE] Cleanup helm chart. Removing ingress, traefik. +refactor
install.sh (#5971)
add a21ec8a Add RawThetaSketchAggregationFunction (#5970)
add 6640aff Instance API to directly updateTags (#5902)
add 107ec3f [TE] Adding Holiday Events in helm chart (#5976)
add 6d8ea75 Remove host from swagger setting (#5983)
add 8900ebb Improve test coverage for TransformFunctionType (#5979)
add a122728 [TE] Added support for BigQuery as data source (#5868)
add 024dfc2 Return datatypes along with column names (#5946)
add cd35332 Use query timeout for planning phase (#5990)
add 2d60312 Improve code coverage for pinot-common (#5986)
add aa6d48f [TE] add threshold-based anomaly labeler (#5972)
add 815c52a add anomaly notification table
add 9caca06 severity alerter & unit tests
add 09944df refactor
add 2c9a272 address comments
add 13c7d66 rebase
add 363004e address comments
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c95c341)
\
N -- N -- N refs/heads/severity-alerter (363004e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.codecov.yml | 14 +-
compatibility-verifier/compCheck.sh | 177 +++++++
kubernetes/helm/thirdeye/Chart.lock | 6 +
kubernetes/helm/thirdeye/Chart.yaml | 24 +
kubernetes/helm/thirdeye/README.md | 82 +++
kubernetes/helm/thirdeye/initdb.sql | 448 ++++++++++++++++
kubernetes/helm/thirdeye/install.sh | 12 +
kubernetes/helm/thirdeye/templates/_helpers.tpl | 117 +++++
.../thirdeye/templates/backend/deployment.yaml | 102 ++++
.../templates/backend/service-headless.yaml | 38 ++
.../helm/thirdeye/templates/backend/service.yaml | 38 ++
.../helm/thirdeye/templates/common/configmap.yaml | 258 ++++++++++
.../thirdeye/templates/frontend/deployment.yaml | 96 ++++
.../templates/frontend/service-headless.yaml | 38 ++
.../helm/thirdeye/templates/frontend/service.yaml | 38 ++
kubernetes/helm/thirdeye/values.yaml | 70 +++
.../apache/pinot/client/PinotResultMetadata.java | 4 +-
.../org/apache/pinot/client/PinotResultSet.java | 5 +-
.../org/apache/pinot/client/utils/Constants.java | 18 +-
.../apache/pinot/client/PinotResultSetTest.java | 53 +-
.../src/test/resources/result_table.json | 48 ++
.../common/function/AggregationFunctionType.java | 12 +-
.../function/FunctionDefinitionRegistry.java | 4 +-
.../common/function/TransformFunctionType.java | 2 +-
.../common/utils/fetcher/HttpSegmentFetcher.java | 15 +
.../function/AggregationFunctionTypeTest.java | 7 +
.../function/FunctionDefinitionRegistryTest.java | 8 +-
.../common/function/TransformFunctionTypeTest.java | 15 +
.../api/ControllerAdminApiApplication.java | 6 +-
.../resources/PinotInstanceRestletResource.java | 23 +
.../helix/ControllerRequestURLBuilder.java | 7 +-
.../helix/core/PinotHelixResourceManager.java | 19 +
.../api/PinotInstanceRestletResourceTest.java | 13 +
.../pinot/controller/helix/ControllerTest.java | 8 +
.../manager/realtime/PinotFSSegmentUploader.java | 6 +-
.../combine/AggregationOnlyCombineOperator.java | 4 +-
.../core/operator/combine/BaseCombineOperator.java | 10 +-
.../operator/combine/GroupByCombineOperator.java | 11 +-
.../combine/GroupByOrderByCombineOperator.java | 11 +-
.../combine/SelectionOnlyCombineOperator.java | 4 +-
.../combine/SelectionOrderByCombineOperator.java | 9 +-
.../apache/pinot/core/plan/CombinePlanNode.java | 25 +-
.../core/plan/maker/InstancePlanMakerImplV2.java | 4 +-
.../apache/pinot/core/plan/maker/PlanMaker.java | 2 +-
.../core/query/aggregation/ThetaSketchParams.java | 66 ---
.../function/AggregationFunctionFactory.java | 2 +
...istinctCountThetaSketchAggregationFunction.java | 60 +--
.../RawThetaSketchAggregationFunction.java | 563 +++++++++++++++++++++
.../query/executor/ServerQueryExecutorV1Impl.java | 10 +-
.../BrokerRequestToQueryContextConverter.java | 7 +-
.../creator/SegmentIndexCreationDriver.java | 3 +
.../impl/SegmentIndexCreationDriverImpl.java | 24 +-
.../pinot/core/util/PeerServerSegmentFinder.java | 27 +-
.../realtime/PinotFSSegmentUploaderTest.java | 4 +-
.../combine/SelectionCombineOperatorTest.java | 6 +-
.../pinot/core/plan/CombinePlanNodeTest.java | 16 +-
.../SegmentGenerationWithNullValueVectorTest.java | 4 +
.../org/apache/pinot/queries/BaseQueriesTest.java | 4 +-
.../queries/DistinctCountThetaSketchTest.java | 226 ++++-----
.../apache/pinot/queries/DistinctQueriesTest.java | 8 +-
.../pinot/query/executor/QueryExecutorTest.java | 6 +
pinot-distribution/pinot-source-assembly.xml | 3 +
...rDownloadLLCRealtimeClusterIntegrationTest.java | 379 ++++++++++++++
.../pinot/hadoop/job/InternalConfigConstants.java | 2 +
.../hadoop/job/mappers/SegmentCreationMapper.java | 67 +++
.../hadoop/data/IngestionSchemaValidatorTest.java | 111 ++++
.../src/test/resources/data/test_sample_data.avro | Bin
.../v0_deprecated/pinot-ingestion-common/pom.xml | 61 +++
.../pinot/ingestion/jobs/SegmentCreationJob.java | 7 +
.../avro/AvroIngestionSchemaValidator.java | 148 ++++++
.../pinot/plugin/inputformat/avro/AvroUtils.java | 1 -
.../pinot/spi/data/IngestionSchemaValidator.java | 22 +-
.../pinot/spi/data/SchemaValidatorFactory.java | 60 +++
.../pinot/spi/data/SchemaValidatorResult.java | 45 +-
thirdeye/docs/bigquery.rst | 95 ++++
thirdeye/docs/datasources.rst | 1 +
thirdeye/install.sh | 34 +-
thirdeye/pom.xml | 50 +-
.../pods/components/rootcause-chart/component.js | 4 +-
.../services/rootcause-timeseries-cache/service.js | 5 +-
thirdeye/thirdeye-pinot/config/dashboard.yml | 1 -
thirdeye/thirdeye-pinot/config/detector.yml | 1 -
thirdeye/thirdeye-pinot/pom.xml | 28 +
.../{constant => anomaly}/AnomalySeverity.java | 23 +-
.../resources/v2/RootCauseTemplateResource.java | 5 +-
...nomalySubscriptionGroupNotificationManager.java | 3 +
.../datalayer/dto/MergedAnomalyResultDTO.java | 19 +-
.../datalayer/pojo/MergedAnomalyResultBean.java | 17 +-
.../datasource/sql/SqlResponseCacheLoader.java | 33 ++
.../pinot/thirdeye/datasource/sql/SqlUtils.java | 23 +
.../thirdeye/detection/DetectionPipeline.java | 22 +
.../detection/DetectionPipelineTaskRunner.java | 2 +-
.../alert/filter/AnomalySeverityAlertFilter.java | 4 +-
.../detection/algorithm/DimensionWrapper.java | 22 +-
.../algorithm/LegacyAlertFilterWrapper.java | 16 +-
.../algorithm/LegacyDimensionWrapper.java | 24 +-
.../detection/algorithm/LegacyMergeWrapper.java | 17 +-
.../thirdeye/detection/algorithm/MergeWrapper.java | 15 +-
.../detection/annotation/DetectionTag.java | 3 +-
.../components/ThresholdSeverityLabeler.java | 88 ++++
.../spec/SeverityThresholdLabelerSpec.java | 49 +-
.../spi/components/Labeler.java} | 15 +-
.../detection/wrapper/AnomalyFilterWrapper.java | 17 +-
...lterWrapper.java => AnomalyLabelerWrapper.java} | 79 +--
.../wrapper/ChildKeepingMergeWrapper.java | 13 +-
.../thirdeye/detection/wrapper/GrouperWrapper.java | 15 +-
.../thirdeye/detection/yaml/YamlResource.java | 104 ++--
.../detection/detection-config-schema.json | 3 +
.../thirdeye/detection/DetectionTestUtils.java | 30 +-
.../detection/alert/filter/AlertFilterUtils.java | 5 +-
.../filter/AnomalySeverityAlertFilterTest.java | 6 +-
.../components/ThresholdRuleAnomalyFilterTest.java | 2 -
.../components/ThresholdSeverityLabelerTest.java | 181 +++++++
.../dataquality/DataQualityTaskRunnerTest.java | 2 +
.../wrapper/ChildKeepingMergeWrapperTest.java | 48 ++
.../thirdeye/detection/yaml/YamlResourceTest.java | 95 +++-
.../yaml/detection/detection-config-3.yaml | 22 +
.../yaml/subscription/subscription-config-6.yaml | 4 +-
...on-config-6.yaml => subscription-config-7.yaml} | 2 +-
119 files changed, 4388 insertions(+), 712 deletions(-)
create mode 100755 compatibility-verifier/compCheck.sh
create mode 100644 kubernetes/helm/thirdeye/Chart.lock
create mode 100644 kubernetes/helm/thirdeye/Chart.yaml
create mode 100644 kubernetes/helm/thirdeye/README.md
create mode 100644 kubernetes/helm/thirdeye/initdb.sql
create mode 100755 kubernetes/helm/thirdeye/install.sh
create mode 100644 kubernetes/helm/thirdeye/templates/_helpers.tpl
create mode 100644 kubernetes/helm/thirdeye/templates/backend/deployment.yaml
create mode 100644
kubernetes/helm/thirdeye/templates/backend/service-headless.yaml
create mode 100644 kubernetes/helm/thirdeye/templates/backend/service.yaml
create mode 100644 kubernetes/helm/thirdeye/templates/common/configmap.yaml
create mode 100644 kubernetes/helm/thirdeye/templates/frontend/deployment.yaml
create mode 100644
kubernetes/helm/thirdeye/templates/frontend/service-headless.yaml
create mode 100644 kubernetes/helm/thirdeye/templates/frontend/service.yaml
create mode 100644 kubernetes/helm/thirdeye/values.yaml
create mode 100644
pinot-clients/pinot-jdbc-client/src/test/resources/result_table.json
delete mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/ThetaSketchParams.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/RawThetaSketchAggregationFunction.java
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/PeerDownloadLLCRealtimeClusterIntegrationTest.java
create mode 100644
pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/test/java/org/apache/pinot/hadoop/data/IngestionSchemaValidatorTest.java
copy {pinot-core =>
pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop}/src/test/resources/data/test_sample_data.avro
(100%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroIngestionSchemaValidator.java
copy
pinot-common/src/test/java/org/apache/pinot/common/function/TransformFunctionTypeTest.java
=>
pinot-spi/src/main/java/org/apache/pinot/spi/data/IngestionSchemaValidator.java
(61%)
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/data/SchemaValidatorFactory.java
copy
pinot-common/src/main/java/org/apache/pinot/common/function/FunctionDefinitionRegistry.java
=>
pinot-spi/src/main/java/org/apache/pinot/spi/data/SchemaValidatorResult.java
(50%)
create mode 100644 thirdeye/docs/bigquery.rst
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{constant =>
anomaly}/AnomalySeverity.java (68%)
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/components/ThresholdSeverityLabeler.java
copy
pinot-common/src/main/java/org/apache/pinot/common/function/FunctionDefinitionRegistry.java
=>
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/spec/SeverityThresholdLabelerSpec.java
(52%)
copy
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{datalayer/bao/AnomalySubscriptionGroupNotificationManager.java
=> detection/spi/components/Labeler.java} (65%)
copy
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/wrapper/{AnomalyFilterWrapper.java
=> AnomalyLabelerWrapper.java} (51%)
create mode 100644
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/components/ThresholdSeverityLabelerTest.java
create mode 100644
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/detection/detection-config-3.yaml
copy
thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/{subscription-config-6.yaml
=> subscription-config-7.yaml} (89%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
