This is an automated email from the ASF dual-hosted git repository. mcvsubbu pushed a change to branch try_helix_hotfix in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 652e0f1 Upgrade Helix to version 0.9.1 add cf980cb [Instance Assignment] Plug in segment assignment for offline segment assignment and table rebalance (#4549) add 66d31d6 Fixing bytes data type merge logic (#4534) add cf9974c Fixing the issue of selection order-by won't give correct ordering (#4540) add f688776 Cleanup preprocess (#4552) add 7c7b6cc Support transform functions with AVG aggregation function (#4557) add 9b5775e [Issue #4551] Remove memory allocation for virtual columns in consumiā¦ (#4555) add d8d0bb5 Add metrics on Helix and Pinot controller leadership (#4561) add 38c73aa Fix the issue of scheduling task on all tables (#4563) add 23ffd67 Handle the virtual column logic in FieldSpec instead of Schema (#4562) add c2f6b25 Indexed table (#4547) add 9edb2cc [TE] frontend - harleyjj/alert-details - add rule and modifier columns to anomaly table (#4564) add 77446e7 [TE] support entity group expression (#4377) add e98efcb [TE] fix multi-day granularity alignment issue (#4566) add 9180dac fixed "StartTree" typo (#4571) add 16cd4fa fixed hyperlink to PinotFS (#4570) add c30ef17 [TE] only store evaluations for top dimensions (#4572) add 3216159 Support aws s3 with Parquet in pinot-tools (#4556) add fbc28d8 [TE] Add timeout for all tasks and clean up RUNNING states if timeout (#4554) add 9df877d Use docker compose for pinot quickstart (#4575) add 584368d Merge LLC related integration tests (#4573) add f3aa4db Retrieve routing table by exact table name instead of by prefix (#3037) add a1c5af7 [TE] Return the anomaly details to render snapshot (#4576) add 05609e4 Use Apache Pinot License (#4584) add 76e0c62 Adding Predicate supports for Bytes Column without dictionary (#4586) add 68092ab Adding integration test for Hadoop pre-process job (#4577) add 3c2f0b3 Adding example for kubernetes deployment on GKE (#4581) add dbcbd2e [TE] Empty Entity report bug fix (#4598) add 5e525d0 [TE] Exclude template/blacklist emails before sending out alert (#4601) add 0a32309 [TE] fix create alert error message NPE (#4594) add e70a781 Add ApacheCon Slide to README file (#4604) add 67ea9bb [TE] Merger fix to consider anomalies generated earlier (#4565) add f5017be [TE] Redesign to support multiple Alert Content formatters (#4599) add add0f07 [TE] Update AI Availability table (#4606) add fe7fff6 [TE] Add anomaly type for merged anomaly result (#4605) add 8f9bb5d [TE] Remove the logic of reading stderr from phantomjs to avoid zombie processes (#4611) add 45205e8 [TE] frontend - harleyjj/alert-details - handle reported anomaly for anomaly table (#4587) add fe29287 [TE] frontend - harleyjj/auth - handle expired token and 401 errors plus redirect after login (#4580) add 76fcc86 [TE] frontend - harleyjj/ai - fix small bug in AI Availability (#4600) add 09207f9 [TE] consider anomaly type during merge (#4613) add 8d593f3 [TE] Bug fix to initialize the configDAO (#4616) add c7b647a [TE][Composite-Alert] Entity Anomaly Merger (#4609) add 9d3180c Upgrade Helix to version 0.9.1 add 5284349 Merge branch 'try_helix_hotfix' of https://github.com/apache/incubator-pinot into try_helix_hotfix No new revisions were added by this update. Summary of changes: README.md | 9 +- docker/Dockerfile | 5 +- docker/README.md | 33 +- docker/docker-build.sh | 11 +- docker/docker-compose.yml | 82 ++ docs/architecture.rst | 2 +- docs/pluggable_storage.rst | 2 +- kubernetes/README.md | 27 + kubernetes/examples/gke/skaffold/README.md | 119 +++ .../examples/gke/skaffold/cleanup.sh | 34 +- .../gke/skaffold/gke-storageclass-kafka-pd.yml | 37 +- .../gke-storageclass-pinot-controller-pd.yml | 37 +- .../skaffold/gke-storageclass-pinot-server-pd.yml | 37 +- .../gke/skaffold/gke-storageclass-zk-pd.yml | 37 +- kubernetes/examples/gke/skaffold/kafka.yml | 408 ++++++++++ kubernetes/examples/gke/skaffold/pinot-broker.yml | 88 +++ .../examples/gke/skaffold/pinot-controller.yml | 106 +++ .../examples/gke/skaffold/pinot-example-loader.yml | 43 + kubernetes/examples/gke/skaffold/pinot-server.yml | 101 +++ .../examples/gke/skaffold/query-pinot-data.sh | 35 +- kubernetes/examples/gke/skaffold/setup.sh | 51 ++ .../examples/gke/skaffold/skaffold.yaml | 44 +- kubernetes/examples/gke/skaffold/zookeeper.yml | 80 ++ .../routing/HelixExternalViewBasedRouting.java | 4 +- .../common}/assignment/InstancePartitions.java | 2 +- .../InstancePartitionsType.java | 12 +- .../assignment/InstancePartitionsUtils.java | 54 +- .../apache/pinot/common/config/TableConfig.java | 2 +- .../apache/pinot/common/config/TagNameUtils.java | 2 +- .../instance/InstanceAssignmentConfigUtils.java | 2 +- .../org/apache/pinot/common/data/FieldSpec.java | 11 + .../java/org/apache/pinot/common/data/Schema.java | 17 +- .../pinot/common/metrics/ControllerGauge.java | 6 + .../common/restlet/resources/RebalanceResult.java | 79 -- .../pinot/common/utils/helix/HelixHelper.java | 47 +- .../pinot/common/config/TableConfigTest.java | 2 +- .../apache/pinot/controller/ControllerStarter.java | 9 +- .../pinot/controller/LeadControllerManager.java | 10 + .../PinotInstanceAssignmentRestletResource.java | 6 +- .../PinotSegmentUploadRestletResource.java | 88 ++- .../api/resources/PinotTableRestletResource.java | 84 +- .../controller/api/upload/SegmentValidator.java | 25 +- .../api/upload/SegmentValidatorResponse.java | 55 -- .../pinot/controller/api/upload/ZKOperator.java | 17 +- .../helix/ControllerRequestURLBuilder.java | 31 +- .../helix/core/PinotHelixResourceManager.java | 161 ++-- .../controller/helix/core/TableRebalancer.java | 735 ----------------- .../instance/InstanceAssignmentDriver.java | 4 +- .../InstanceReplicaGroupPartitionSelector.java | 2 +- .../segment/OfflineSegmentAssignment.java | 4 +- .../segment/RealtimeSegmentAssignment.java | 10 +- .../core/assignment/segment/SegmentAssignment.java | 4 +- .../assignment/segment/SegmentAssignmentUtils.java | 8 +- .../helix/core/minion/PinotTaskManager.java | 11 +- .../core/periodictask/ControllerPeriodicTask.java | 14 +- .../rebalance/DefaultRebalanceSegmentStrategy.java | 359 --------- ...onstants.java => RebalanceConfigConstants.java} | 26 +- .../helix/core/rebalance/RebalanceResult.java | 71 ++ .../core/rebalance/RebalanceSegmentStrategy.java | 55 -- .../rebalance/RebalanceSegmentStrategyFactory.java | 50 -- .../ReplicaGroupRebalanceSegmentStrategy.java | 532 ------------- .../helix/core/rebalance/TableRebalancer.java | 405 ++++++++++ .../core/relocation/RealtimeSegmentRelocator.java | 249 ++---- .../BalanceNumSegmentAssignmentStrategy.java | 98 --- .../core/sharding/BucketizedSegmentStrategy.java | 66 -- .../core/sharding/RandomAssignmentStrategy.java | 64 -- .../ReplicaGroupSegmentAssignmentStrategy.java | 105 --- .../sharding/SegmentAssignmentStrategyFactory.java | 46 -- .../helix/core/util/ZKMetadataUtils.java | 4 +- ...PinotInstanceAssignmentRestletResourceTest.java | 4 +- .../api/PinotTableRestletResourceTest.java | 59 +- .../pinot/controller/helix/ControllerTest.java | 2 +- .../instance/InstanceAssignmentTest.java | 4 +- ...fflineNonReplicaGroupSegmentAssignmentTest.java | 4 +- .../OfflineReplicaGroupSegmentAssignmentTest.java | 4 +- ...altimeNonReplicaGroupSegmentAssignmentTest.java | 8 +- .../RealtimeReplicaGroupSegmentAssignmentTest.java | 8 +- .../segment/SegmentAssignmentUtilsTest.java | 2 +- .../rebalance/DefaultRebalanceStrategyTest.java | 639 --------------- .../ReplicaGroupRebalanceStrategyTest.java | 318 -------- .../core/rebalance/TableRebalancerClusterTest.java | 322 ++++++++ .../helix/core/rebalance/TableRebalancerTest.java | 187 +++++ .../relocation/RealtimeSegmentRelocatorTest.java | 292 ------- .../sharding/SegmentAssignmentStrategyTest.java | 330 -------- .../helix/core/util/TableRebalancerTest.java | 427 ---------- .../controller/utils/ReplicaGroupTestUtils.java | 140 ---- .../apache/pinot/core/data/order/OrderByUtils.java | 295 +++++++ .../apache/pinot/core/data/readers/FileFormat.java | 2 +- .../core/data/table/ConcurrentIndexedTable.java | 137 ++++ .../apache/pinot/core/data/table/IndexedTable.java | 69 ++ .../java/org/apache/pinot/core/data/table/Key.java | 50 +- .../org/apache/pinot/core/data/table/Record.java | 31 +- .../pinot/core/data/table/SimpleIndexedTable.java | 126 +++ .../org/apache/pinot/core/data/table/Table.java | 68 ++ .../pinot/core/indexsegment/IndexSegment.java | 2 +- .../generator/SegmentGeneratorConfig.java | 8 +- .../immutable/ImmutableSegmentImpl.java | 27 +- .../immutable/ImmutableSegmentLoader.java | 6 +- .../indexsegment/mutable/MutableSegmentImpl.java | 117 ++- .../dociditerators/SVScanDocIdIterator.java | 11 + .../operator/docvalsets/TransformBlockValSet.java | 6 + .../BaseDictionaryBasedPredicateEvaluator.java | 10 + .../BaseRawValueBasedPredicateEvaluator.java | 26 + .../predicate/EqualsPredicateEvaluatorFactory.java | 22 + .../predicate/InPredicateEvaluatorFactory.java | 26 + .../NotEqualsPredicateEvaluatorFactory.java | 22 + .../predicate/NotInPredicateEvaluatorFactory.java | 27 + .../filter/predicate/PredicateEvaluator.java | 17 + .../predicate/RangePredicateEvaluatorFactory.java | 51 ++ .../transform/TransformBlockDataFetcher.java | 5 +- .../core/query/selection/SelectionFetcher.java | 5 +- .../query/selection/SelectionOperatorService.java | 10 +- .../query/selection/SelectionOperatorUtils.java | 24 +- ...ator.java => BytesSelectionColumnIterator.java} | 20 +- ...SelectionSingleValueColumnWithDictIterator.java | 5 - .../iterator/StringSelectionColumnIterator.java | 10 +- .../creator/impl/SegmentColumnarIndexCreator.java | 5 +- .../impl/SegmentIndexCreationDriverImpl.java | 20 +- .../name/NormalizedDateSegmentNameGenerator.java | 4 - .../VirtualColumnProviderFactory.java | 6 +- .../pinot/core/data/order/OrderByUtilsTest.java | 265 +++++++ .../pinot/core/data/table/IndexedTableTest.java | 275 +++++++ .../MutableSegmentImplAggregateMetricsTest.java | 30 +- .../NoDictionaryEqualsPredicateEvaluatorsTest.java | 37 + .../NoDictionaryInPredicateEvaluatorTest.java | 40 + .../NoDictionaryRangePredicateEvaluatorTest.java | 57 ++ .../predicate/PredicateEvaluatorTestUtils.java | 7 + .../apache/pinot/queries/TransformQueriesTest.java | 267 +++++++ .../selection/SelectionOperatorServiceTest.java | 46 +- .../pinot/hadoop/job/InternalConfigConstants.java | 7 + .../pinot/hadoop/job/JobConfigConstants.java | 4 +- .../pinot/hadoop/job/SegmentCreationJob.java | 17 +- .../pinot/hadoop/job/SegmentPreprocessingJob.java | 321 +++----- .../job/mappers/SegmentPreprocessingMapper.java | 40 +- .../job/reducers/SegmentPreprocessingReducer.java | 4 +- .../pinot/hadoop/utils/JobPreparationHelper.java | 11 + ...umSegmentAssignmentStrategyIntegrationTest.java | 136 ---- .../tests/ClusterIntegrationTestUtils.java | 45 +- .../pinot/integration/tests/ClusterTest.java | 8 +- ...mentBuildPushOfflineClusterIntegrationTest.java | 101 +-- .../tests/LLCRealtimeClusterIntegrationTest.java | 100 ++- ...CRealtimeClusterSplitCommitIntegrationTest.java | 44 -- .../tests/OfflineClusterIntegrationTest.java | 16 + ...eRebalancerAdminToolClusterIntegrationTest.java | 871 --------------------- ...e_Performance_2014_100k_subset.test_queries_10K | 2 +- .../apache/pinot/perf/BenchmarkIndexedTable.java | 218 ++++++ pinot-tools/pom.xml | 20 + .../apache/pinot/tools/PinotSegmentRebalancer.java | 242 ------ .../apache/pinot/tools/PinotTableRebalancer.java | 121 +-- .../pinot/tools/admin/PinotAdministrator.java | 42 +- .../tools/admin/command/CreateSegmentCommand.java | 74 +- .../tools/admin/command/RebalanceCommand.java | 114 --- .../tools/admin/command/RebalanceTableCommand.java | 101 ++- .../pinot/tools/perf/PerfBenchmarkDriver.java | 4 - .../query/comparison/SegmentInfoProvider.java | 43 +- .../airlineStats_offline_table_config.json | 0 .../docker/airlineStats_realtime_table_config.json | 38 + pom.xml | 5 + .../app/pods/aiavailability/route.js | 30 +- .../app/pods/application/route.js | 1 + .../app/pods/components/alert-details/component.js | 32 +- .../app/pods/components/alert-details/template.hbs | 26 + .../thirdeye-frontend/app/pods/home/index/route.js | 13 + thirdeye/thirdeye-frontend/app/pods/login/route.js | 25 +- .../app/pods/manage/alerts/index/route.js | 1 + .../app/pods/manage/alerts/route.js | 13 +- .../app/pods/manage/explore/route.js | 25 +- .../thirdeye-frontend/app/pods/manage/route.js | 13 +- .../app/pods/manage/yaml/route.js | 25 +- .../thirdeye-frontend/app/pods/rootcause/route.js | 13 +- .../app/pods/services/query-cache/service.js | 8 +- thirdeye/thirdeye-frontend/app/utils/anomaly.js | 8 + .../thirdeye-frontend/app/utils/api/anomaly.js | 2 +- .../thirdeye/alert/commons/AnomalyFeedConfig.java | 6 +- .../alert/content/EmailContentFormatter.java | 62 -- .../EmailContentFormatterConfiguration.java | 128 --- .../thirdeye/alert/fetcher/BaseAnomalyFetcher.java | 4 +- .../apache/pinot/thirdeye/anomaly/AnomalyType.java | 22 +- .../thirdeye/anomaly/alert/AlertJobContext.java | 1 + .../thirdeye/anomaly/alert/AlertTaskInfo.java | 1 + ...nshotHelper.java => AlertScreenshotHelper.java} | 56 +- .../anomaly/alert/util/AnomalyReportGenerator.java | 2 +- .../thirdeye/anomaly/alert/util/EmailHelper.java | 29 +- .../anomaly/alert/v2/AlertTaskRunnerV2.java | 40 +- .../anomaly/monitor/MonitorTaskRunner.java | 23 +- .../tasks/FunctionCreationOnboardingTask.java | 7 +- .../onboard/tasks/NotificationOnboardingTask.java | 34 +- .../pinot/thirdeye/anomaly/task/TaskDriver.java | 47 +- .../anomaly/task/TaskDriverConfiguration.java | 9 + .../AbstractModularizedAnomalyFunction.java | 2 +- .../pinot/thirdeye/datalayer/bao/TaskManager.java | 2 + .../datalayer/bao/jdbc/TaskManagerImpl.java | 7 + .../thirdeye/datalayer/dto/AnomalyFunctionDTO.java | 7 +- .../datalayer/pojo/MergedAnomalyResultBean.java | 14 + .../{StringUtils.java => ThirdEyeStringUtils.java} | 2 +- .../thirdeye/detection/DefaultDataProvider.java | 37 +- .../pinot/thirdeye/detection/DetectionUtils.java | 6 - .../pinot/thirdeye/detection/ExpressionParser.java | 141 ++++ .../alert/scheme/DetectionEmailAlerter.java | 84 +- .../detection/algorithm/DimensionWrapper.java | 19 +- .../thirdeye/detection/algorithm/MergeWrapper.java | 126 ++- .../components/TriggerConditionGrouper.java | 20 +- .../thirdeye/detection/spi/model/AnomalySlice.java | 52 +- .../validators/DetectionConfigValidator.java | 2 +- .../wrapper/BaselineFillingMergeWrapper.java | 19 +- .../wrapper/ChildKeepingMergeWrapper.java | 5 +- .../wrapper/EntityAnomalyMergeWrapper.java | 77 ++ .../thirdeye/detection/wrapper/GrouperWrapper.java | 2 +- .../thirdeye/detection/yaml/YamlResource.java | 10 +- .../yaml/translator/DetectionConfigTranslator.java | 18 +- .../commons/EmailEntity.java | 2 +- .../content/BaseNotificationContent.java} | 327 +++----- .../notification/content/NotificationContent.java | 55 ++ .../content/templates/EntityGroupKeyContent.java} | 42 +- .../templates/HierarchicalAnomaliesContent.java} | 90 ++- .../content/templates/MetricAnomaliesContent.java} | 48 +- .../templates/OnboardingNotificationContent.java} | 42 +- .../formatter/ADContentFormatterContext.java} | 8 +- .../formatter/AlertContentFormatterFactory.java} | 14 +- .../formatter/channels/EmailContentFormatter.java | 125 +++ .../commons/TestEmailContentFormatterFactory.java | 39 - .../alert/fetcher/TestContinuumAnomalyFetcher.java | 7 +- .../transform/testAnomalyRemovalFunction.java | 2 +- ...UtilsTest.java => ThirdEyeStringUtilsTest.java} | 4 +- .../pinot/thirdeye/detection/DataProviderTest.java | 2 +- .../detection/algorithm/DimensionWrapperTest.java | 32 +- .../algorithm/LegacyDimensionWrapperTest.java | 12 +- .../detection/algorithm/MergeWrapperTest.java | 58 +- .../detection/components/ExpressionParserTest.java | 90 +++ .../components/TriggerConditionGrouperTest.java | 37 +- .../wrapper/EntityAnomalyMergeWrapperTest.java | 136 ++++ .../ContentFormatterUtils.java | 8 +- .../templates/TestEntityGroupKeyContent.java} | 31 +- .../TestHierarchicalAnomaliesContent.java} | 20 +- .../templates/TestMetricAnomaliesContent.java} | 19 +- .../TestOnboardingNotificationContent.java} | 19 +- .../TestAlertContentFormatterFactory.java | 41 + .../compositePipelineTranslatorTestResult-1.json | 93 ++- 238 files changed, 7282 insertions(+), 8348 deletions(-) create mode 100644 docker/docker-compose.yml create mode 100644 kubernetes/README.md create mode 100644 kubernetes/examples/gke/skaffold/README.md copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/cleanup.sh (53%) copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/gke-storageclass-kafka-pd.yml (52%) mode change 100755 => 100644 copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/gke-storageclass-pinot-controller-pd.yml (52%) mode change 100755 => 100644 copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/gke-storageclass-pinot-server-pd.yml (52%) mode change 100755 => 100644 copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/gke-storageclass-zk-pd.yml (52%) mode change 100755 => 100644 create mode 100644 kubernetes/examples/gke/skaffold/kafka.yml create mode 100644 kubernetes/examples/gke/skaffold/pinot-broker.yml create mode 100644 kubernetes/examples/gke/skaffold/pinot-controller.yml create mode 100644 kubernetes/examples/gke/skaffold/pinot-example-loader.yml create mode 100644 kubernetes/examples/gke/skaffold/pinot-server.yml copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/query-pinot-data.sh (52%) create mode 100755 kubernetes/examples/gke/skaffold/setup.sh copy docker/docker-build.sh => kubernetes/examples/gke/skaffold/skaffold.yaml (52%) mode change 100755 => 100644 create mode 100644 kubernetes/examples/gke/skaffold/zookeeper.yml rename {pinot-controller/src/main/java/org/apache/pinot/controller/helix/core => pinot-common/src/main/java/org/apache/pinot/common}/assignment/InstancePartitions.java (98%) rename pinot-common/src/main/java/org/apache/pinot/common/{utils => assignment}/InstancePartitionsType.java (75%) rename {pinot-controller/src/main/java/org/apache/pinot/controller/helix/core => pinot-common/src/main/java/org/apache/pinot/common}/assignment/InstancePartitionsUtils.java (74%) delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/RebalanceResult.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/upload/SegmentValidatorResponse.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/TableRebalancer.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/DefaultRebalanceSegmentStrategy.java rename pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/{RebalanceUserConfigConstants.java => RebalanceConfigConstants.java} (59%) create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/RebalanceResult.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/RebalanceSegmentStrategy.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/RebalanceSegmentStrategyFactory.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/ReplicaGroupRebalanceSegmentStrategy.java create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/TableRebalancer.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/BalanceNumSegmentAssignmentStrategy.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/BucketizedSegmentStrategy.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/RandomAssignmentStrategy.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/ReplicaGroupSegmentAssignmentStrategy.java delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/SegmentAssignmentStrategyFactory.java delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/rebalance/DefaultRebalanceStrategyTest.java delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/rebalance/ReplicaGroupRebalanceStrategyTest.java create mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/rebalance/TableRebalancerClusterTest.java create mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/rebalance/TableRebalancerTest.java delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/relocation/RealtimeSegmentRelocatorTest.java delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/sharding/SegmentAssignmentStrategyTest.java delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/util/TableRebalancerTest.java delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/utils/ReplicaGroupTestUtils.java create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/order/OrderByUtils.java create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/table/ConcurrentIndexedTable.java create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/table/IndexedTable.java rename pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/SegmentAssignmentStrategy.java => pinot-core/src/main/java/org/apache/pinot/core/data/table/Key.java (52%) rename pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/LLCRealtimeClusterWithEnabledLeadControllerResourceIntegrationTest.java => pinot-core/src/main/java/org/apache/pinot/core/data/table/Record.java (63%) create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/table/SimpleIndexedTable.java create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/table/Table.java copy pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/{StringSelectionColumnIterator.java => BytesSelectionColumnIterator.java} (69%) create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/order/OrderByUtilsTest.java create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/table/IndexedTableTest.java create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/TransformQueriesTest.java delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/BalanceNumSegmentAssignmentStrategyIntegrationTest.java delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/LLCRealtimeClusterSplitCommitIntegrationTest.java delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/TableRebalancerAdminToolClusterIntegrationTest.java create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkIndexedTable.java delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/PinotSegmentRebalancer.java delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/RebalanceCommand.java copy pinot-tools/src/main/resources/sample_data/{ => docker}/airlineStats_offline_table_config.json (100%) create mode 100644 pinot-tools/src/main/resources/sample_data/docker/airlineStats_realtime_table_config.json delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EmailContentFormatter.java delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EmailContentFormatterConfiguration.java rename pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/sharding/SegmentAssignmentStrategyEnum.java => thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/AnomalyType.java (71%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/util/{EmailScreenshotHelper.java => AlertScreenshotHelper.java} (56%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/util/{StringUtils.java => ThirdEyeStringUtils.java} (98%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/ExpressionParser.java create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/wrapper/EntityAnomalyMergeWrapper.java rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert => notification}/commons/EmailEntity.java (97%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/content/BaseEmailContentFormatter.java => notification/content/BaseNotificationContent.java} (70%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/NotificationContent.java rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/content/EntityGroupKeyContentFormatter.java => notification/content/templates/EntityGroupKeyContent.java} (84%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/content/HierarchicalAnomaliesEmailContentFormatter.java => notification/content/templates/HierarchicalAnomaliesContent.java} (67%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/content/MetricAnomaliesEmailContentFormatter.java => notification/content/templates/MetricAnomaliesContent.java} (81%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/content/OnboardingNotificationEmailContentFormatter.java => notification/content/templates/OnboardingNotificationContent.java} (75%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/content/EmailContentFormatterContext.java => notification/formatter/ADContentFormatterContext.java} (88%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{alert/commons/EmailContentFormatterFactory.java => notification/formatter/AlertContentFormatterFactory.java} (65%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/channels/EmailContentFormatter.java delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/commons/TestEmailContentFormatterFactory.java rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/datalayer/util/{StringUtilsTest.java => ThirdEyeStringUtilsTest.java} (75%) create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/components/ExpressionParserTest.java create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/wrapper/EntityAnomalyMergeWrapperTest.java rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/{alert/content => notification}/ContentFormatterUtils.java (83%) rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/{alert/content/TestEntityGroupKeyEmailContentFormatter.java => notification/content/templates/TestEntityGroupKeyContent.java} (91%) rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/{alert/content/TestHierarchicalAnomaliesEmailContentFormatter.java => notification/content/templates/TestHierarchicalAnomaliesContent.java} (89%) rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/{alert/content/TestMetricAnomaliesEmailContentFormatter.java => notification/content/templates/TestMetricAnomaliesContent.java} (88%) rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/{alert/content/TestOnboardingNotificationContentFormatter.java => notification/content/templates/TestOnboardingNotificationContent.java} (89%) create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/formatter/TestAlertContentFormatterFactory.java --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org