This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch pinot-ingestion-refactor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 731565a Add linking
discard 84e95d6 upgrade version
discard a77676e Adding support for retry and back-off
discard b3c6836 update with new API
discard ae6ed97 Adding config to control spark job push parallism
discard e352860 Fixing parent directory creation issue
discard 1211b99 don't use default conf
discard 51f7280 fixing class: com.databricks.backend.daemon.data.client.DBFS
not serializable issue
discard 6f51b3c Ensure segment push job is Serializable
discard 79811cb Make spark job an option to parallel push segments
discard 0f420cf Address comments
discard 1fe80e9 Move segment tars recursively and override existed files
discard 0f02a45 Initial refactor
discard 3fc0caf Make temp directory with uuid appended
discard bf53e3b Make PushLocation Serializable
discard d678005 Use SparkContext.getOrCreate() to use shared SparkContext if
possible.
discard 1bea1c2 Initial commit for pinot-spark
add dada6e2 [TE] Minor fix on DataAvailabilityTaskScheduler (#4853)
add 2f18f65 [TE] add detection health for the alerts list (#4842)
add 0f64e4a Fixing encryption for .tar.gz upload (#4855)
add 98f8c9a [TE] Update AI Availability dashboard to v2 (#4857)
add c0f8b7a Fix the controller rest API for non local FS. (#4808)
add 5c02b14 Split BrokerReduceService code into several DataTableReducers
(#4851)
add 54fb020 [TE] Enable local debugging of CSV data (#4826)
add b558e81 [TE] add default constructor for detection health status
(#4861)
add a2a27d8 [TE] Refactor the fetch anomalies interface to incorporate
config id within the anomaly slice (#4846)
add 69f68b0 Initial commit for pinot-spark
add baf3e38 Use SparkContext.getOrCreate() to use shared SparkContext if
possible.
add 3866151 Make PushLocation Serializable
add e6639c4 Make temp directory with uuid appended
add 3fe3ee4 Initial refactor
add 10823e1 Move segment tars recursively and override existed files
add 8a0a506 Address comments
add 02f1f6a Make spark job an option to parallel push segments
add 2362a07 Ensure segment push job is Serializable
add 74cc45c fixing class: com.databricks.backend.daemon.data.client.DBFS
not serializable issue
add 37c1bfd don't use default conf
add bb900bf Fixing parent directory creation issue
add 0e031f4 Adding config to control spark job push parallism
add 8a6d36b update with new API
add 99e7bc9 Adding support for retry and back-off
add bd69212 upgrade version
add 3b6097b Add linking
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (731565a)
\
N -- N -- N refs/heads/pinot-ingestion-refactor (3b6097b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../PinotSegmentUploadDownloadRestletResource.java | 57 +-
.../query/reduce/AggregationDataTableReducer.java | 109 ++++
.../core/query/reduce/BrokerReduceService.java | 633 +--------------------
.../pinot/core/query/reduce/DataTableReducer.java | 45 ++
.../query/reduce/DistinctDataTableReducer.java | 132 +++++
.../core/query/reduce/GroupByDataTableReducer.java | 438 ++++++++++++++
.../core/query/reduce/ResultReducerFactory.java | 60 ++
.../query/reduce/SelectionDataTableReducer.java | 136 +++++
pom.xml | 7 +
.../app/pods/manage/alerts/index/route.js | 6 +-
.../thirdeye-frontend/app/utils/api/anomaly.js | 2 +-
.../thirdeye-frontend/app/utils/api/self-serve.js | 2 +-
.../config/data-sources/data-sources-config.yml | 15 +
thirdeye/thirdeye-pinot/config/data/pageviews.csv | 67 +++
thirdeye/thirdeye-pinot/config/h2db.mv.db | Bin 4947968 -> 2949120
bytes
.../trigger/DataAvailabilityTaskScheduler.java | 2 +-
.../DataAvailabilitySchedulingConfiguration.java | 4 +-
.../anomaly/monitor/MonitorTaskRunner.java | 31 +
.../datalayer/pojo/DetectionConfigBean.java | 11 +
.../datasource/mock/MockThirdEyeDataSource.java | 89 ++-
.../datasource/sql/SqlResponseCacheLoader.java | 63 +-
.../pinot/thirdeye/datasource/sql/SqlUtils.java | 15 +-
.../pinot/thirdeye/detection/DataProvider.java | 3 +-
.../thirdeye/detection/DefaultDataProvider.java | 11 +-
.../detection/DefaultInputDataFetcher.java | 9 +-
.../thirdeye/detection/DetectionResource.java | 51 +-
.../detection/StaticDetectionPipeline.java | 9 +-
.../alert/StatefulDetectionAlertFilter.java | 11 +-
.../algorithm/LegacyAnomalyFunctionAlgorithm.java | 7 +-
.../detection/algorithm/LegacyMergeWrapper.java | 3 +-
.../thirdeye/detection/algorithm/MergeWrapper.java | 3 +-
.../detection/algorithm/MovingWindowAlgorithm.java | 1 +
.../finetune/GridSearchTuningAlgorithm.java | 3 +-
.../detection/health/AnomalyCoverageStatus.java | 5 +
.../thirdeye/detection/health/DetectionHealth.java | 25 +
.../detection/health/DetectionTaskStatus.java | 9 +
.../detection/health/RegressionStatus.java | 8 +
.../thirdeye/detection/spi/model/AnomalySlice.java | 85 ++-
.../wrapper/EntityAnomalyMergeWrapper.java | 3 +-
.../thirdeye/detection/yaml/YamlResource.java | 50 +-
.../formatter/DetectionAlertConfigFormatter.java | 2 +
.../formatter/DetectionConfigFormatter.java | 26 +-
.../pinot/thirdeye/detection/DataProviderTest.java | 8 +-
.../detection/DetectionPipelineTaskRunnerTest.java | 3 +
.../pinot/thirdeye/detection/MockDataProvider.java | 14 +-
45 files changed, 1470 insertions(+), 803 deletions(-)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/AggregationDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/DataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/DistinctDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/GroupByDataTableReducer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/ResultReducerFactory.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/reduce/SelectionDataTableReducer.java
create mode 100644 thirdeye/thirdeye-pinot/config/data/pageviews.csv
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
