This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch clean-up-controller-singleton
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard a737d14 Refactor ControllerLeaderManager by using dependency
injection instead of singleton
new 501eeaf [TE] Display preview running window; Show warning before
preview (#4050)
new 153c52d [TE] Speed up minute level detection (#4053)
new b2c8aed [TE] frontend - harleyjj/preview - restrict time range for
yaml/preview to present (#4044)
new aaef725 Handle exceptions during teardown (#4055)
new 2b25dd9 [TE] revert early termination in detection loop (#4056)
new dad8773 skip .swp files for vim users (#4052)
new e9a49ec Fix the race condition for real-time inverted index reader
(#4051)
new 7b61bfc [TE] disable anomalies endpoint padding for minute level
alerts (#4058)
new 35f5e15 Add wait_time flag for Travis config (#4057)
new 69db491 add support for parquet reader (#3852)
new 402e5ad In ServiceStatus, replace Apache math Pair with inner
StatusDescriptionPair class (#4062)
new c8d2f7f Fix minute speedup (#4060)
new 8121927 [TE] frontend - harleyjj/alert-overview - display dash and
n/a when value is undefined (#4046)
new 8c3edbb [TE] Clean up logging messages; remove default ref links
(#4059)
new fdd9b92 [TE] Disable thirdeye-hadoop (#4064)
new f66c342 [TE] frontend - harleyjj/yaml-editor - surface error message
in put (#4068)
new 8036bff Move Parquet related classes to the new package (#4073)
new a102ee0 [TE] frontend - harleyjj/yaml-editor - if there is no
existing subscription group, the user can create one on edit-alert (#4071)
new 0655993 [TE] frontend - harleyjj/anomalies - prototype anomalies
route replacement (#4066)
new 3a9625b Introduce interface stability and audience annotations (#4063)
new 08ad552 [TE] SQL connector, with support for Presto, MySQL, H2. With
a front end for onboarding dataset (#3830)
new 972472e Fix travis-wait (#4077)
new b08eccc [TE] detection - handle day light savings time in moving
windows (#4072)
new 641e401 Exit 1 when caught exception in Pinot Admin command. (#4065)
new 6cb2ffa Remove stale test RealtimeTableDataManagerTest (#4075)
new 2d860d2 Always enable default column feature, remove the
configuration (#4074)
new 78bfe3e Fix 500 issue with 'GET /tenants' API call (#4061)
new 23adfcd [TE] Email template - Truncate long names; Make links more
intuitive to click
new 58a926e Reduce logging in controller (#4078)
new a2c8d37 Support legacy time type in
SegmentValidationAndRetentionConfig (#4081)
new af62e20 Revert travis-wait config (#4084)
new e115bc9 In TimeUtils.timeUnitFromString(), return null if input is
null or empty (#4088)
new 0ee5a1d [TE] Minor correction to #4079 (#4083)
new 4003155 [TE] frontend - harleyjj/rca - override date-picker component
to maintain 0:00 as end stamp (#4080)
new 435e8be Update doc for "Creating Pinot segments" to reflect the
current code base (#4086)
new 9c3b7a8 [TE] frontend - harleyjj/anomalies - update filters and
feedback status to be consistent (#4090)
new 7516f4a In HelixBrokerStarter, allow custom cluster change handlers
(#4089)
new 3a1e386 Extend stream interfaces to expose message metadata like
ingestion timestamp (#4025)
new 5344efb [TE] fix sql metric import page endpoint (#4091)
new c153fa7 Refactor ControllerLeaderManager by using dependency
injection instead of singleton
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a737d14)
\
N -- N -- N refs/heads/clean-up-controller-singleton (c153fa7)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 5942 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 1 +
docs/pinot_hadoop.rst | 262 +-
...okerResourceOnlineOfflineStateModelFactory.java | 30 +-
.../broker/broker/helix/ClusterChangeHandler.java | 8 +-
.../broker/broker/helix/ClusterChangeMediator.java | 33 +-
.../broker/helix/ExternalViewChangeHandler.java | 43 -
.../broker/broker/helix/HelixBrokerStarter.java | 129 +-
.../broker/helix/InstanceConfigChangeHandler.java | 38 -
.../broker/helix/LiveInstanceChangeHandler.java | 7 +-
.../broker/queryquota/TableQueryQuotaManager.java | 12 +-
.../routing/HelixExternalViewBasedRouting.java | 16 +-
.../HelixExternalViewBasedTimeBoundaryService.java | 42 +-
.../pinot/annotations/InterfaceAudience.java | 73 +
.../pinot/annotations/InterfaceStability.java | 70 +
.../SegmentsValidationAndRetentionConfig.java | 16 +-
.../apache/pinot/common/config/TagNameUtils.java | 5 +-
.../pinot/common/segment/SegmentMetadata.java | 16 +
.../apache/pinot/common/utils/ServiceStatus.java | 62 +-
.../apache/pinot/common/utils/time/TimeUtils.java | 61 +-
.../org/apache/pinot/common/utils/UtilsTest.java | 69 +-
.../api/resources/PinotTableRestletResource.java | 7 +-
.../helix/core/PinotHelixResourceManager.java | 22 +-
.../helix/core/retention/RetentionManager.java | 4 +-
.../pinot/controller/util/TableSizeReader.java | 9 +-
.../validation/OfflineSegmentIntervalChecker.java | 9 +-
.../helix/core/PinotHelixResourceManagerTest.java | 54 +-
pinot-core/pom.xml | 33 +-
.../manager/config/InstanceDataManagerConfig.java | 2 -
.../realtime/HLRealtimeSegmentDataManager.java | 7 +-
.../realtime/LLRealtimeSegmentDataManager.java | 11 +-
.../pinot/core/data/readers/AvroRecordReader.java | 35 +-
.../pinot/core/data/readers/RecordReader.java | 3 +-
.../core/data/readers/RecordReaderFactory.java | 8 +-
.../pinot/core/indexsegment/IndexSegment.java | 3 +-
.../core/indexsegment/mutable/MutableSegment.java | 6 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 33 +-
.../operator/filter/BitmapBasedFilterOperator.java | 26 +-
.../invertedindex/RealtimeInvertedIndexReader.java | 13 +-
.../impl/kafka/KafkaStreamLevelConsumer.java | 8 +-
.../pinot/core/realtime/stream/MessageBatch.java | 16 +
.../realtime/stream/PartitionLevelConsumer.java | 4 +
.../core/realtime/stream/StreamLevelConsumer.java | 14 +
.../core/realtime/stream/StreamMessageDecoder.java | 40 +
.../realtime/stream/StreamMessageMetadata.java} | 34 +-
.../realtime/stream/StreamMetadataProvider.java | 4 +
.../core/segment/index/SegmentMetadataImpl.java | 15 +
.../segment/index/loader/IndexLoadingConfig.java | 12 +-
.../segment/index/loader/SegmentPreProcessor.java | 2 +-
.../name/NormalizedDateSegmentNameGenerator.java | 18 +-
.../java/org/apache/pinot/core/util/AvroUtils.java | 42 +-
.../realtime/LLRealtimeSegmentDataManagerTest.java | 1 -
.../MutableSegmentImplAggregateMetricsTest.java | 4 +-
.../mutable/MutableSegmentImplTest.java | 4 +-
.../RealtimeInvertedIndexReaderTest.java | 106 +
.../NormalizedDateSegmentNameGeneratorTest.java | 33 +-
.../pinot/hadoop/job/SegmentCreationJob.java | 2 +-
.../hadoop/job/mapper/SegmentCreationMapper.java | 10 +-
.../tests/ChaosMonkeyIntegrationTest.java | 1 +
.../pinot/integration/tests/ClusterTest.java | 19 +-
.../tests/OfflineClusterIntegrationTest.java | 103 +-
pinot-orc/pom.xml | 2 +-
.../pinot/orc/data/readers/ORCRecordReader.java | 48 +-
{pinot-hadoop-filesystem => pinot-parquet}/pom.xml | 37 +-
.../parquet/data/readers/ParquetRecordReader.java | 78 +-
.../pinot/parquet/data/readers/ParquetUtils.java | 87 +
.../data/readers/ParquetRecordReaderTest.java | 101 +
.../helix/HelixInstanceDataManagerConfig.java | 8 -
.../realtime/RealtimeTableDataManagerTest.java | 320 -
.../pinot/tools/admin/PinotAdministrator.java | 9 +-
.../pinot/tools/admin/command/AddTableCommand.java | 5 +
.../realtime/provisioning/MemoryEstimator.java | 6 +-
.../segment/converter/SegmentMergeCommand.java | 11 +-
pom.xml | 7 +
thirdeye/pom.xml | 1 -
.../app/pods/anomalies/controller.js | 431 +
.../thirdeye-frontend/app/pods/anomalies/route.js | 144 +
.../app/pods/anomalies/template.hbs | 98 +
.../app/pods/components/alert-details/component.js | 32 +-
.../app/pods/components/alert-details/template.hbs | 20 +-
.../pods/components/anomaly-summary/component.js | 276 +
.../pods/components/anomaly-summary/template.hbs | 111 +
.../app/pods/components/entity-filter/component.js | 7 +-
.../rootcause-chart-toolbar/component.js | 4 +-
.../app/pods/components/yaml-editor/component.js | 88 +-
.../app/pods/components/yaml-editor/template.hbs | 12 +-
.../app/pods/self-serve/create-alert/template.hbs | 6 +-
.../self-serve/import-sql-metric/controller.js | 137 +
.../pods/self-serve/import-sql-metric/template.hbs | 166 +
thirdeye/thirdeye-frontend/app/router.js | 2 +
.../styles/components/range-pill-selectors.scss | 1 -
thirdeye/thirdeye-frontend/app/utils/anomaly.js | 17 +-
.../thirdeye-frontend/app/utils/api/anomaly.js | 13 +-
thirdeye/thirdeye-frontend/app/utils/constants.js | 4 +-
.../config/data-sources/data-sources-config.yml | 25 +-
thirdeye/thirdeye-pinot/config/data/README.md | 7 +
thirdeye/thirdeye-pinot/config/data/daily.csv | 732 +
thirdeye/thirdeye-pinot/config/data/hourly.csv | 66498 +++++++++++++++++++
thirdeye/thirdeye-pinot/config/h2db.mv.db | Bin 2330624 -> 0 bytes
thirdeye/thirdeye-pinot/pom.xml | 5 +
.../pinot/thirdeye/anomaly/task/TaskDriver.java | 8 +-
.../MultiDimensionalSummaryCLITool.java | 2 +-
...mmaryClient.java => ThirdEyeSummaryClient.java} | 8 +-
.../dashboard/ThirdEyeDashboardApplication.java | 2 +
.../dashboard/resources/SummaryResource.java | 6 +-
.../resources/v2/RootCauseMetricResource.java | 2 +-
.../thirdeye/datalayer/util/DaoProviderUtil.java | 3 -
.../pinot/thirdeye/datasource/RelationalQuery.java | 35 +-
...sponse.java => RelationalThirdEyeResponse.java} | 7 +-
.../loader/DefaultAggregationLoader.java | 2 +-
.../datasource/mock/AutoOnboardMockDataSource.java | 58 +-
.../datasource/mock/MockThirdEyeDataSource.java | 2 +-
.../pinot/PinotControllerResponseCacheLoader.java | 10 +-
.../datasource/pinot/PinotDataSourceMaxTime.java | 2 +-
.../thirdeye/datasource/pinot/PinotQuery.java | 28 +-
.../datasource/pinot/PinotThirdEyeDataSource.java | 252 +-
.../resultset/ThirdEyeDataFrameResultSet.java | 82 +-
.../pinot/resultset/ThirdEyeResultSetUtils.java | 190 +
.../pinot/thirdeye/datasource/sql/SqlDataset.java | 88 +
.../pinot/thirdeye/datasource/sql/SqlQuery.java | 113 +
.../datasource/sql/SqlResponseCacheLoader.java | 330 +
.../datasource/sql/SqlThirdEyeDataSource.java | 140 +
.../{pinot/PqlUtils.java => sql/SqlUtils.java} | 451 +-
.../sql/resources/SqlDataSourceResource.java | 54 +
.../detection/DetectionPipelineScheduler.java | 2 +-
.../pinot/thirdeye/detection/DetectionUtils.java | 18 +
.../pinot/thirdeye/detection/alert/AlertUtils.java | 3 -
.../detection/alert/DetectionAlertJob.java | 10 +-
.../detection/alert/DetectionAlertScheduler.java | 8 +-
.../detection/alert/DetectionAlertTaskRunner.java | 2 +-
.../thirdeye/detection/algorithm/MergeWrapper.java | 1 -
.../detection/wrapper/AnomalyDetectorWrapper.java | 99 +-
.../yaml/CompositePipelineConfigTranslator.java | 48 +-
.../yaml/YamlDetectionAlertConfigTranslator.java | 6 +-
.../detector/function/BaseAnomalyFunction.java | 4 -
.../rootcause/impl/MetricAnalysisPipeline.java | 2 +-
.../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 116 +
.../thirdeye/detector/holiday-anomaly-report.ftl | 92 +-
.../src/main/resources/schema/create-schema.sql | 4 +-
.../pinot/PinotThirdEyeDataSourceTest.java | 18 +-
.../wrapper/AnomalyDetectorWrapperTest.java | 25 +
.../YamlDetectionAlertConfigTranslatorTest.java | 2 +-
.../AnomalyApplicationEndToEndTest.java | 4 +-
...multiple-anomalies-email-content-formatter.html | 74 +-
143 files changed, 71882 insertions(+), 1857 deletions(-)
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/ExternalViewChangeHandler.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/InstanceConfigChangeHandler.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceAudience.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceStability.java
copy
pinot-core/src/{test/java/org/apache/pinot/core/realtime/stream/MetadataEqualsHashCodeTest.java
=> main/java/org/apache/pinot/core/realtime/stream/StreamMessageMetadata.java}
(56%)
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeInvertedIndexReaderTest.java
copy {pinot-hadoop-filesystem => pinot-parquet}/pom.xml (85%)
copy
pinot-core/src/main/java/org/apache/pinot/core/data/readers/JSONRecordReader.java
=>
pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetRecordReader.java
(59%)
create mode 100644
pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetUtils.java
create mode 100644
pinot-parquet/src/test/java/org/apache/pinot/parquet/data/readers/ParquetRecordReaderTest.java
delete mode 100644
pinot-server/src/test/java/org/apache/pinot/server/integration/realtime/RealtimeTableDataManagerTest.java
create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/controller.js
create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/route.js
create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/template.hbs
create mode 100644
thirdeye/thirdeye-frontend/app/pods/components/anomaly-summary/component.js
create mode 100644
thirdeye/thirdeye-frontend/app/pods/components/anomaly-summary/template.hbs
create mode 100644
thirdeye/thirdeye-frontend/app/pods/self-serve/import-sql-metric/controller.js
create mode 100644
thirdeye/thirdeye-frontend/app/pods/self-serve/import-sql-metric/template.hbs
create mode 100644 thirdeye/thirdeye-pinot/config/data/README.md
create mode 100644 thirdeye/thirdeye-pinot/config/data/daily.csv
create mode 100755 thirdeye/thirdeye-pinot/config/data/hourly.csv
delete mode 100644 thirdeye/thirdeye-pinot/config/h2db.mv.db
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/client/diffsummary/{PinotThirdEyeSummaryClient.java
=> ThirdEyeSummaryClient.java} (97%)
copy
pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/FloatingPointLiteralAstNode.java
=>
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/RelationalQuery.java
(63%)
rename
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/{pinot/PinotThirdEyeResponse.java
=> RelationalThirdEyeResponse.java} (93%)
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/pinot/resultset/ThirdEyeResultSetUtils.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlDataset.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlQuery.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlResponseCacheLoader.java
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlThirdEyeDataSource.java
copy
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/{pinot/PqlUtils.java
=> sql/SqlUtils.java} (54%)
create mode 100644
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/resources/SqlDataSourceResource.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
