This is an automated email from the ASF dual-hosted git repository.
jackie pushed a change to branch resource_allocation
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard e79b208 commit
add 61b4814 [TE] Make new alerter tag old anomalies as notified (#3554)
add ac74d13 [TE] frontend - harleyjj/manage - pass correct granularity to
buildMetricDataUrl (#3557)
add a834a49 [TE] pom - fix javassist dependency (#3559)
add 232360f Fixes to doc (#3558)
add d9ad5c3 Removing warnings in docs (#3560)
add 1e6fc74 Adding pluggable storage support for realtime upload (#3541)
add 44c2859 [TE] detection - copy nested property in wrapper (#3562)
add 45063b0 Re-org documentation (#3563)
add b62c611 [TE] frontend - harleyjj/create-alert - make minor
improvements to YAML alert creator (#3564)
add eceaf76 [TE] Legacy Alert Filter should pick recipients from new
alerter configs (#3565)
add 5a610be Add metric gauge to track the number of llc simultaneous
segment builds (#3566)
add 9dfb949 [TE] rootcause - rich metric selector (#3567)
add 8b2efec [TE] detection - filter out child anomaly in anomaly fetching
(#3570)
add f1559a7 Docs: Fix formatting for UDF docs. (#3569)
add 88ba23a [TE] rootcause - change frontend hack for baseline for new
pipeline (#3571)
add 213ff9c [TE] Configure Filters per Alert in Legacy Alerter (#3572)
add f1512e6 [TE] rootcause - hide heatmap tooltip on click (#3574)
add c752a4f Improve the logging for segment merge command (#3573)
add 75a4f85 Adding support for bloom filter (#3528)
new 0cec099 Initial commit on the interfaces
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e79b208)
\
N -- N -- N refs/heads/resource_allocation (0cec099)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/architecture.rst | 128 +++++++++++------
docs/client_api.rst | 56 ++++----
docs/conf.py | 4 +-
docs/creating_pinot_segments.rst | 98 -------------
docs/expressions_udf.rst | 25 ++--
docs/index.rst | 36 +++--
docs/intro.rst | 30 ++--
docs/llc.rst | 26 +++-
docs/management_api.rst | 6 +-
docs/multitenancy.rst | 24 ++--
docs/partition_aware_routing.rst | 6 +-
docs/pinot_hadoop.rst | 157 ++++++++++++++++----
docs/pluggable_streams.rst | 64 ++++-----
docs/pql_examples.rst | 140 ++++++++++--------
docs/reference.rst | 7 +-
docs/schema_timespec.rst | 82 +++++------
docs/segment_fetcher.rst | 16 +--
docs/trying_pinot.rst | 46 +++---
.../pinot/common/config/AssignmentConfig.java | 6 +-
.../pinot/common/config/IndexingConfig.java | 12 ++
.../linkedin/pinot/common/config/TableConfig.java | 7 +
.../pinot/common/metrics/AbstractMetrics.java | 29 +++-
.../linkedin/pinot/common/metrics/ServerGauge.java | 3 +-
.../pinot/common/segment/SegmentMetadata.java | 2 +
.../resources/LLCSegmentCompletionHandlers.java | 77 +++++-----
.../core/assignment/instance/InstanceRole.java | 9 +-
.../instance/InstanceSelectionResult.java | 45 ++++++
.../instance/InstanceSelectionResultUtils.java | 35 ++---
.../instance/InstanceSelectionStrategy.java | 10 +-
.../core/assignment/instance/InstanceTags.java | 116 +++++++++++++++
.../assignment/instance/InstanceTagsUtils.java | 42 ++++++
.../instance/constraint/InstanceConstraint.java | 21 ++-
.../constraint/NumInstancesConstraint.java | 15 +-
.../constraint/ReplicaGroupInstanceConstraint.java | 14 +-
.../TagExactMatchInstanceConstraint.java | 48 +++++++
.../segment/SegmentAssignmentStrategy.java | 34 +++++
.../helix/core/instance/InstanceAttributes.java | 68 ---------
.../helix/core/instance/InstancePoolUtils.java | 34 -----
.../helix/core/instance/InstanceRole.java | 5 -
.../instance/assignment/AssignmentStrategy.java | 4 -
.../instances/AllInstancesConstraint.java | 22 ---
.../FixedNumInstancesPerReplicaConstraint.java | 42 ------
.../instances/NumInstancesConstraint.java | 17 ---
.../replicagroup/CustomReplicaGroupConstraint.java | 12 --
.../DefaultReplicaGroupConstraint.java | 43 ------
.../replicagroup/NoReplicaGroupConstraint.java | 13 --
.../replicagroup/ReplicaGroupConstraint.java | 16 ---
.../instance/selection/result/SelectionResult.java | 32 -----
.../selection/result/SelectionResultUtils.java | 20 ---
.../selection/strategy/SelectionStrategy.java | 12 --
.../core/assignment/instance/InstanceTagsTest.java | 117 +++++++++++++++
.../com/linkedin/pinot/core/bloom/BloomFilter.java | 69 +++++++++
.../linkedin/pinot/core/bloom/BloomFilterType.java | 50 +++++++
.../linkedin/pinot/core/bloom/BloomFilterUtil.java | 54 +++++++
.../pinot/core/bloom/GuavaOnHeapBloomFilter.java | 74 ++++++++++
.../core/bloom/SegmentBloomFilterFactory.java | 48 +++++++
.../com/linkedin/pinot/core/common/DataSource.java | 3 +
.../realtime/LLRealtimeSegmentDataManager.java | 5 +
.../indexsegment/mutable/MutableSegmentImpl.java | 5 +-
.../core/query/pruner/AbstractSegmentPruner.java | 17 ++-
.../query/pruner/ColumnValueSegmentPruner.java | 44 ++++--
.../core/query/pruner/PartitionSegmentPruner.java | 10 +-
.../core/segment/creator/impl/V1Constants.java | 1 +
.../creator/impl/bloom/BloomFilterCreator.java | 66 +++++++++
.../core/segment/index/SegmentMetadataImpl.java | 5 +
.../segment/index/column/ColumnIndexContainer.java | 3 +
.../index/column/PhysicalColumnIndexContainer.java | 21 +++
.../index/data/source/ColumnDataSource.java | 17 ++-
.../segment/index/loader/IndexLoadingConfig.java | 17 +++
.../segment/index/loader/SegmentPreProcessor.java | 7 +-
.../loader/bloomfilter/BloomFilterHandler.java | 160 +++++++++++++++++++++
.../segment/index/readers/BloomFilterReader.java | 54 +++++++
.../core/segment/store/ColumnIndexDirectory.java | 18 ++-
.../pinot/core/segment/store/ColumnIndexType.java | 3 +-
.../core/segment/store/FilePerIndexDirectory.java | 17 +++
.../segment/store/SegmentLocalFSDirectory.java | 5 +
.../segment/store/SingleFileIndexDirectory.java | 12 ++
.../virtualcolumn/VirtualColumnIndexContainer.java | 6 +
.../v2/store/StarTreeDimensionDataSource.java | 6 +
.../v2/store/StarTreeMetricDataSource.java | 6 +
.../core/common/RealtimeNoDictionaryTest.java | 8 +-
.../index/creator/BloomFilterCreatorTest.java | 150 +++++++++++++++++++
.../store/ColumnIndexDirectoryTestHelper.java | 15 ++
.../query/pruner/ColumnValueSegmentPrunerTest.java | 4 +-
.../com/linkedin/pinot/filesystem/PinotFS.java | 2 +-
.../tests/BaseClusterIntegrationTest.java | 6 +
.../pinot/integration/tests/ClusterTest.java | 26 ++--
...mentBuildPushOfflineClusterIntegrationTest.java | 2 +-
.../tests/HybridClusterIntegrationTest.java | 4 +-
...ridClusterIntegrationTestCommandLineRunner.java | 2 +-
.../tests/OfflineClusterIntegrationTest.java | 39 ++++-
.../tests/RealtimeClusterIntegrationTest.java | 4 +-
.../tests/SimpleMinionClusterIntegrationTest.java | 6 +-
.../linkedin/pinot/perf/PerfBenchmarkRunner.java | 71 ---------
.../com/linkedin/pinot/perf/PerfBenchmarkTest.java | 77 ----------
.../pinot/tools/perf/PerfBenchmarkDriver.java | 6 +-
.../pinot/tools/perf/PerfBenchmarkRunner.java | 16 ++-
.../segment/converter/SegmentMergeCommand.java | 47 +++---
pom.xml | 1 +
thirdeye/pom.xml | 7 +
.../app/mirage/endpoints/rootcause.js | 3 +-
.../app/pods/components/filter-select/component.js | 14 +-
.../app/pods/components/heatmap-chart/component.js | 3 +
.../rootcause-select-metric-dimension/component.js | 9 +-
.../rootcause-select-metric-dimension/template.hbs | 2 +-
.../rootcause-select-metric/component.js | 46 ++++--
.../rootcause-select-metric/template.hbs | 6 +-
.../pods/custom/metrics-table-metric/template.hbs | 2 +-
.../app/pods/manage/alert/explore/route.js | 3 +-
.../rootcause/select-metric-label/template.hbs | 6 +
.../app/pods/self-serve/create-alert/controller.js | 36 ++++-
.../app/pods/self-serve/create-alert/template.hbs | 8 +-
.../styles/components/rootcause-select-metric.scss | 28 +++-
.../tests/acceptance/rootcause-test.js | 7 +-
thirdeye/thirdeye-pinot/pom.xml | 4 +
.../MultipleAnomaliesEmailContentFormatter.java | 4 +-
.../thirdeye/anomaly/events/EventFilter.java | 7 +
.../anomaly/events/HolidayEventProvider.java | 3 +-
.../v2/rootcause/AnomalyEventFormatter.java | 4 -
.../thirdeye/detection/DefaultDataProvider.java | 9 +-
.../detection/DetectionMigrationResource.java | 15 +-
.../thirdeye/detection/DetectionResource.java | 35 +++--
.../detection/alert/DetectionAlertTaskRunner.java | 11 ++
.../detection/alert/filter/LegacyAlertFilter.java | 61 +++++---
.../thirdeye/detection/algorithm/MergeWrapper.java | 37 +++--
.../detection/wrapper/AnomalyFilterWrapper.java | 13 +-
.../wrapper/BaselineFillingMergeWrapper.java | 2 +-
.../wrapper/ChildKeepingMergeWrapper.java | 9 +-
.../detector/email/filter/BaseAlertFilter.java | 2 +-
.../alert/filter/LegacyAlertFilterTest.java | 31 ++--
.../wrapper/ChildKeepingMergeWrapperTest.java | 13 +-
131 files changed, 2411 insertions(+), 1251 deletions(-)
delete mode 100644 docs/creating_pinot_segments.rst
copy
thirdeye/thirdeye-hadoop/src/main/java/com/linkedin/thirdeye/hadoop/join/MapOutputKey.java
=>
pinot-common/src/main/java/com/linkedin/pinot/common/config/AssignmentConfig.java
(89%)
copy
pinot-common/src/main/java/com/linkedin/pinot/common/metadata/ZKMetadata.java
=>
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceRole.java
(80%)
create mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceSelectionResult.java
copy
pinot-core/src/main/java/com/linkedin/pinot/core/common/BlockMultiValIterator.java
=>
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceSelectionResultUtils.java
(54%)
copy
thirdeye/thirdeye-pinot/src/main/java/com/linkedin/thirdeye/datalayer/dto/RootcauseSessionDTO.java
=>
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceSelectionStrategy.java
(64%)
create mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceTags.java
create mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceTagsUtils.java
copy
thirdeye/thirdeye-pinot/src/main/java/com/linkedin/thirdeye/detection/algorithm/stage/BaseDetectionStage.java
=>
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/constraint/InstanceConstraint.java
(59%)
copy
thirdeye/thirdeye-pinot/src/main/java/com/linkedin/thirdeye/anomaly/classification/classifier/BaseAnomalyClassifier.java
=>
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/constraint/NumInstancesConstraint.java
(61%)
copy
thirdeye/thirdeye-pinot/src/main/java/com/linkedin/thirdeye/anomaly/alert/grouping/BaseAlertGrouper.java
=>
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/constraint/ReplicaGroupInstanceConstraint.java
(60%)
create mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/instance/constraint/TagExactMatchInstanceConstraint.java
create mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/assignment/segment/SegmentAssignmentStrategy.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/InstanceAttributes.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/InstancePoolUtils.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/InstanceRole.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/assignment/AssignmentStrategy.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/instances/AllInstancesConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/instances/FixedNumInstancesPerReplicaConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/instances/NumInstancesConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/replicagroup/CustomReplicaGroupConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/replicagroup/DefaultReplicaGroupConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/replicagroup/NoReplicaGroupConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/constraint/replicagroup/ReplicaGroupConstraint.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/result/SelectionResult.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/result/SelectionResultUtils.java
delete mode 100644
pinot-controller/src/main/java/com/linkedin/pinot/controller/helix/core/instance/selection/strategy/SelectionStrategy.java
create mode 100644
pinot-controller/src/test/java/com/linkedin/pinot/controller/helix/core/assignment/instance/InstanceTagsTest.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/bloom/BloomFilter.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/bloom/BloomFilterType.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/bloom/BloomFilterUtil.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/bloom/GuavaOnHeapBloomFilter.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/bloom/SegmentBloomFilterFactory.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/segment/creator/impl/bloom/BloomFilterCreator.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/segment/index/loader/bloomfilter/BloomFilterHandler.java
create mode 100644
pinot-core/src/main/java/com/linkedin/pinot/core/segment/index/readers/BloomFilterReader.java
create mode 100644
pinot-core/src/test/java/com/linkedin/pinot/core/segment/index/creator/BloomFilterCreatorTest.java
delete mode 100644
pinot-perf/src/main/java/com/linkedin/pinot/perf/PerfBenchmarkRunner.java
delete mode 100644
pinot-perf/src/main/java/com/linkedin/pinot/perf/PerfBenchmarkTest.java
create mode 100644
thirdeye/thirdeye-frontend/app/pods/partials/rootcause/select-metric-label/template.hbs
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
