This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch adding_pinot_minion_segment_creation_tasks_2
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard a254c01 Address comments
discard 9ecf2f1 Adding logic to infer recordreader classes from input format
discard 152d031 Adding pinot minion segment creation task
add fb42e72 [TE]frontend - Add breadcrumb component (#6350)
add a76e766 Broker time range pruning(#6189) (#6259)
add 5432099 [TE]frontend - Add a lightweight PubSub system (#6358)
add 8e41708 6355 don't lose authority portion of inputDirURI (#6359)
add 2ea0185 Enhance task schedule api for single type/table support
(#6352)
add 79b12ed Fix empty data table for distinct query (#6363)
add e3ae45b Adding pinot minion segment creation task
add 5f27806 Adding logic to infer recordreader classes from input format
add dc1fb27 Address comments
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a254c01)
\
N -- N -- N
refs/heads/adding_pinot_minion_segment_creation_tasks_2 (dc1fb27)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.gitignore | 2 +
.../pinot/broker/routing/RoutingManager.java | 4 +-
.../instanceselector/BaseInstanceSelector.java | 2 -
.../segmentpruner/PartitionSegmentPruner.java | 7 +-
.../routing/segmentpruner/SegmentPruner.java | 3 +-
.../segmentpruner/SegmentPrunerFactory.java | 50 +-
.../routing/segmentpruner/TimeSegmentPruner.java | 346 +++++++
.../routing/segmentpruner/interval/Interval.java | 104 +++
.../segmentpruner/interval/IntervalTree.java | 201 +++++
.../segmentselector/OfflineSegmentSelector.java | 8 +-
.../segmentselector/RealtimeSegmentSelector.java | 31 +-
.../routing/segmentselector/SegmentSelector.java | 3 +-
.../broker/routing/IntervalST/IntervalTest.java | 57 ++
.../routing/IntervalST/IntervalTreeTest.java | 89 ++
.../routing/segmentpruner/SegmentPrunerTest.java | 285 +++++-
.../apache/pinot/common/minion/MinionClient.java | 17 +-
.../common/minion/MinionRequestURLBuilder.java | 14 +-
.../pinot/common/minion/MinionClientTest.java | 2 +-
.../api/resources/PinotTaskRestletResource.java | 16 +-
.../helix/core/minion/PinotTaskManager.java | 169 ++--
.../SegmentGenerationAndPushTaskGenerator.java | 50 +-
.../core/common/datatable/DataTableUtils.java | 95 +-
.../core/common/datatable/DataTableUtilsTest.java | 28 +-
...vertToRawIndexMinionClusterIntegrationTest.java | 6 +-
.../tests/HybridClusterIntegrationTest.java | 2 +-
...fflineSegmentsMinionClusterIntegrationTest.java | 6 +-
.../tests/SimpleMinionClusterIntegrationTest.java | 17 +-
.../SegmentGenerationAndPushTaskExecutor.java | 66 +-
.../batch/common/SegmentGenerationUtilsTest.java | 16 +
.../standalone/SegmentGenerationJobRunner.java | 10 +-
.../standalone/SegmentGenerationJobRunnerTest.java | 54 ++
.../src/test/resources/log4j2.xml | 0
.../pinot/spi/config/table/RoutingConfig.java | 1 +
.../spi/ingestion/batch/BatchConfigProperties.java | 1 -
.../org/apache/pinot/tools/BootstrapTableTool.java | 5 +-
.../airlineStats_offline_table_config.json | 7 +-
.../pods/components/breadcrumb-list/component.js | 56 ++
.../pods/components/breadcrumb-list/template.hbs | 10 +
.../components/composite-anomalies/component.js | 87 ++
.../components/composite-anomalies/template.hbs | 8 +
.../explore/composite-anomalies/controller.js | 76 +-
.../manage/explore/composite-anomalies/route.js | 6 +-
.../explore/composite-anomalies/template.hbs | 18 +-
thirdeye/thirdeye-frontend/app/styles/app.scss | 1 +
.../app/styles/components/breadcrumb-list.scss | 19 +
.../app/styles/shared/_styles.scss | 10 +
thirdeye/thirdeye-frontend/app/utils/pub-sub.js | 72 ++
thirdeye/thirdeye-frontend/package.json | 7 +-
.../components/breadcrumb-list/component-test.js | 33 +
.../composite-anomalies/component-test.js | 20 +
.../tests/unit/utils/pub-sub-test.js | 19 +
thirdeye/thirdeye-frontend/yarn.lock | 996 ++++++++++++++++++++-
52 files changed, 2937 insertions(+), 275 deletions(-)
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/TimeSegmentPruner.java
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/interval/Interval.java
create mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/interval/IntervalTree.java
create mode 100644
pinot-broker/src/test/java/org/apache/pinot/broker/routing/IntervalST/IntervalTest.java
create mode 100644
pinot-broker/src/test/java/org/apache/pinot/broker/routing/IntervalST/IntervalTreeTest.java
create mode 100644
pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/test/java/org/apache/pinot/plugin/ingestion/batch/standalone/SegmentGenerationJobRunnerTest.java
copy {pinot-tools =>
pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone}/src/test/resources/log4j2.xml
(100%)
create mode 100644
thirdeye/thirdeye-frontend/app/pods/components/breadcrumb-list/component.js
create mode 100644
thirdeye/thirdeye-frontend/app/pods/components/breadcrumb-list/template.hbs
create mode 100644
thirdeye/thirdeye-frontend/app/pods/components/composite-anomalies/component.js
create mode 100644
thirdeye/thirdeye-frontend/app/pods/components/composite-anomalies/template.hbs
create mode 100644
thirdeye/thirdeye-frontend/app/styles/components/breadcrumb-list.scss
create mode 100644 thirdeye/thirdeye-frontend/app/utils/pub-sub.js
create mode 100644
thirdeye/thirdeye-frontend/tests/integration/pods/components/breadcrumb-list/component-test.js
create mode 100644
thirdeye/thirdeye-frontend/tests/integration/pods/components/composite-anomalies/component-test.js
create mode 100644 thirdeye/thirdeye-frontend/tests/unit/utils/pub-sub-test.js
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
