kaisun2000 commented on issue #1280: URL: https://github.com/apache/helix/issues/1280#issuecomment-698737876
>2020-09-25T05:29:32.6374477Z START TestClusterStatusMonitorLifecycle at Fri Sep 25 05:29:31 UTC 2020 2020-09-25T05:29:32.6376950Z 4354570 [ZkClient-EventThread-85911-localhost:2183] ERROR org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks - Interrupted waiting for success 2020-09-25T05:29:32.6378744Z java.lang.InterruptedException 2020-09-25T05:29:32.6379330Z at java.lang.Object.wait(Native Method) 2020-09-25T05:29:32.6379884Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:29:32.6381552Z at org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks$DefaultCallback.waitForSuccess(ZkAsyncCallbacks.java:220) 2020-09-25T05:29:32.6383803Z at org.apache.helix.zookeeper.zkclient.ZkClient.issueSync(ZkClient.java:1308) 2020-09-25T05:29:32.6385451Z at org.apache.helix.zookeeper.zkclient.ZkClient.access$300(ZkClient.java:83) 2020-09-25T05:29:32.6387037Z at org.apache.helix.zookeeper.zkclient.ZkClient$4.run(ZkClient.java:1334) 2020-09-25T05:29:32.6388705Z at org.apache.helix.zookeeper.zkclient.ZkEventThread.run(ZkEventThread.java:99) 2020-09-25T05:29:34.5040939Z 4356506 [ZkClient-EventThread-54905-localhost:2183] ERROR org.apache.helix.manager.zk.ZKHelixManager - fail to connect zkserver: localhost:2183 in 60000ms. expiredSessionId: 100000495350e0f, clusterName: TestSessionExpiryInTransition_testSessionExpiryInTransition 2020-09-25T05:29:35.2808288Z 4357282 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_0-(88f9ab53_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_0. Pipeline will not be invoked 2020-09-25T05:29:36.4336072Z 4358434 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_3-(9ada8c3f_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_1 is not leader for TestClusterStatusMonitorLifecycle0_3. Pipeline will not be invoked 2020-09-25T05:29:36.4361997Z 4358434 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_3-(9ada8c3f_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_1 is not leader for TestClusterStatusMonitorLifecycle0_3. Pipeline will not be invoked 2020-09-25T05:29:36.8914580Z 4358893 [ZkClient-EventThread-86704-localhost:2183] ERROR org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks - Interrupted waiting for success 2020-09-25T05:29:36.8917155Z java.lang.InterruptedException 2020-09-25T05:29:36.8918066Z at java.lang.Object.wait(Native Method) 2020-09-25T05:29:36.8918865Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:29:36.8920758Z at org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks$DefaultCallback.waitForSuccess(ZkAsyncCallbacks.java:220) 2020-09-25T05:29:36.8923304Z at org.apache.helix.zookeeper.zkclient.ZkClient.issueSync(ZkClient.java:1308) 2020-09-25T05:29:36.8925197Z at org.apache.helix.zookeeper.zkclient.ZkClient.access$300(ZkClient.java:83) 2020-09-25T05:29:36.8926889Z at org.apache.helix.zookeeper.zkclient.ZkClient$4.run(ZkClient.java:1334) 2020-09-25T05:29:36.8928708Z at org.apache.helix.zookeeper.zkclient.ZkEventThread.run(ZkEventThread.java:99) 2020-09-25T05:29:40.5169690Z 4362518 [ZkClient-EventThread-86806-localhost:2183] ERROR org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks - Interrupted waiting for success 2020-09-25T05:29:40.5172270Z java.lang.InterruptedException 2020-09-25T05:29:40.5173180Z at java.lang.Object.wait(Native Method) 2020-09-25T05:29:40.5173988Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:29:40.5175907Z at org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks$DefaultCallback.waitForSuccess(ZkAsyncCallbacks.java:220) 2020-09-25T05:29:40.5178406Z at org.apache.helix.zookeeper.zkclient.ZkClient.issueSync(ZkClient.java:1308) 2020-09-25T05:29:40.5180341Z at org.apache.helix.zookeeper.zkclient.ZkClient.access$300(ZkClient.java:83) 2020-09-25T05:29:40.5182019Z at org.apache.helix.zookeeper.zkclient.ZkClient$4.run(ZkClient.java:1334) 2020-09-25T05:29:40.5183809Z at org.apache.helix.zookeeper.zkclient.ZkEventThread.run(ZkEventThread.java:99) 2020-09-25T05:29:42.8393973Z 4364841 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(9a7caa77_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_2 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:29:42.9865450Z 4364988 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_3-(18603a76_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_4 is not leader for TestClusterStatusMonitorLifecycle0_3. Pipeline will not be invoked 2020-09-25T05:29:42.9966477Z 4364990 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_3-(18603a76_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_4 is not leader for TestClusterStatusMonitorLifecycle0_3. Pipeline will not be invoked 2020-09-25T05:29:42.9979615Z 4364992 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_4-(7b86e416_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_4. Pipeline will not be invoked 2020-09-25T05:29:43.0004276Z 4364992 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_4-(7b86e416_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_4. Pipeline will not be invoked 2020-09-25T05:29:43.0009972Z 4364995 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_9-(4e2a4b46_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_3 is not leader for TestClusterStatusMonitorLifecycle0_9. Pipeline will not be invoked 2020-09-25T05:29:43.1379060Z 4365139 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_0-(1f8ca0d3_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_1 is not leader for TestClusterStatusMonitorLifecycle0_0. Pipeline will not be invoked 2020-09-25T05:29:43.1417297Z 4365141 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_0-(1f8ca0d3_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_1 is not leader for TestClusterStatusMonitorLifecycle0_0. Pipeline will not be invoked 2020-09-25T05:29:44.1232115Z 4366125 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_4-(a604ada1_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_3 is not leader for TestClusterStatusMonitorLifecycle0_4. Pipeline will not be invoked 2020-09-25T05:29:44.1493972Z 4366151 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_1-(9c5c3f68_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_4 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:29:44.1518274Z 4366152 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(9c5c3f68_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_4 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:29:44.6330270Z 4366634 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_3-(9b8b553e_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_3. Pipeline will not be invoked 2020-09-25T05:29:44.6335865Z 4366634 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_3-(9b8b553e_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_3. Pipeline will not be invoked 2020-09-25T05:29:45.0859246Z 4367087 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_1-(3ffea822_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_5 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:29:45.5026865Z 4367504 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_9-(b4627538_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_2 is not leader for TestClusterStatusMonitorLifecycle0_9. Pipeline will not be invoked 2020-09-25T05:29:47.6263475Z 4368635 [ZkClient-EventThread-87441-localhost:2183] ERROR org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks - Interrupted waiting for success 2020-09-25T05:29:47.6265554Z java.lang.InterruptedException 2020-09-25T05:29:47.6266176Z at java.lang.Object.wait(Native Method) 2020-09-25T05:29:47.6267218Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:29:47.6269071Z at org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks$DefaultCallback.waitForSuccess(ZkAsyncCallbacks.java:220) 2020-09-25T05:29:47.6271382Z at org.apache.helix.zookeeper.zkclient.ZkClient.issueSync(ZkClient.java:1308) 2020-09-25T05:29:47.6273030Z at org.apache.helix.zookeeper.zkclient.ZkClient.access$300(ZkClient.java:83) 2020-09-25T05:29:47.6274467Z at org.apache.helix.zookeeper.zkclient.ZkClient$4.run(ZkClient.java:1334) 2020-09-25T05:29:47.6276000Z at org.apache.helix.zookeeper.zkclient.ZkEventThread.run(ZkEventThread.java:99) 2020-09-25T05:29:58.7359986Z START TestClusterStatusMonitorLifecycle testClusterStatusMonitorLifecycle at Fri Sep 25 05:29:58 UTC 2020 2020-09-25T05:29:58.8493533Z 4380851 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_0-(df0430bf_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_6 is not leader for TestClusterStatusMonitorLifecycle0_0. Pipeline will not be invoked 2020-09-25T05:29:58.9323365Z 4380934 [ZkClient-EventThread-87493-localhost:2183] ERROR org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks - Interrupted waiting for success 2020-09-25T05:29:58.9326273Z java.lang.InterruptedException 2020-09-25T05:29:58.9329201Z at java.lang.Object.wait(Native Method) 2020-09-25T05:29:58.9330098Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:29:58.9332019Z at org.apache.helix.zookeeper.zkclient.callback.ZkAsyncCallbacks$DefaultCallback.waitForSuccess(ZkAsyncCallbacks.java:220) 2020-09-25T05:29:58.9334522Z at org.apache.helix.zookeeper.zkclient.ZkClient.issueSync(ZkClient.java:1308) 2020-09-25T05:29:58.9336405Z at org.apache.helix.zookeeper.zkclient.ZkClient.access$300(ZkClient.java:83) 2020-09-25T05:29:58.9338075Z at org.apache.helix.zookeeper.zkclient.ZkClient$4.run(ZkClient.java:1334) 2020-09-25T05:29:58.9339918Z at org.apache.helix.zookeeper.zkclient.ZkEventThread.run(ZkEventThread.java:99) 2020-09-25T05:30:01.9114207Z 4383911 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_7-(ee3a471d_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_7. Pipeline will not be invoked 2020-09-25T05:30:01.9127059Z 4383911 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_7-(ee3a471d_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_0 is not leader for TestClusterStatusMonitorLifecycle0_7. Pipeline will not be invoked 2020-09-25T05:30:01.9861219Z 4383988 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_8-(db9dd4b0_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_1 is not leader for TestClusterStatusMonitorLifecycle0_8. Pipeline will not be invoked 2020-09-25T05:30:01.9897887Z 4383989 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_8-(db9dd4b0_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_1 is not leader for TestClusterStatusMonitorLifecycle0_8. Pipeline will not be invoked 2020-09-25T05:30:02.1325149Z 4384134 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_5-(3c3fd961_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_4 is not leader for TestClusterStatusMonitorLifecycle0_5. Pipeline will not be invoked 2020-09-25T05:30:02.3872523Z 4384383 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_7-(a6fc1d69_DEFAULT)] ERROR org.apache.helix.controller.rebalancer.waged.WagedRebalancer - Failed to calculate the new assignments. 2020-09-25T05:30:02.3875954Z org.apache.helix.HelixRebalanceException: Failed to get the current baseline assignment because of unexpected error. Failure Type: INVALID_REBALANCER_STATUS 2020-09-25T05:30:02.3878627Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBaselineAssignment(WagedRebalancer.java:631) 2020-09-25T05:30:02.3882287Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.globalRebalance(WagedRebalancer.java:420) 2020-09-25T05:30:02.3886839Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleAssignment(WagedRebalancer.java:354) 2020-09-25T05:30:02.3890897Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleStates(WagedRebalancer.java:327) 2020-09-25T05:30:02.3894616Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeNewIdealStates(WagedRebalancer.java:262) 2020-09-25T05:30:02.3899736Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.computeResourceBestPossibleStateWithWagedRebalancer(BestPossibleStateCalcStage.java:270) 2020-09-25T05:30:02.3904571Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.compute(BestPossibleStateCalcStage.java:126) 2020-09-25T05:30:02.3907599Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.process(BestPossibleStateCalcStage.java:85) 2020-09-25T05:30:02.3910755Z at org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68) 2020-09-25T05:30:02.3913024Z at org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777) 2020-09-25T05:30:02.3915398Z at org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128) 2020-09-25T05:30:02.3917648Z at org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407) 2020-09-25T05:30:02.3920205Z Caused by: org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:02.3922766Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:02.3924729Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1831) 2020-09-25T05:30:02.3926394Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1823) 2020-09-25T05:30:02.3928079Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.get(ZkBaseDataAccessor.java:473) 2020-09-25T05:30:02.3930341Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:260) 2020-09-25T05:30:02.3933157Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:238) 2020-09-25T05:30:02.3936435Z at org.apache.helix.controller.rebalancer.waged.AssignmentMetadataStore.getBaseline(AssignmentMetadataStore.java:69) 2020-09-25T05:30:02.3940031Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBaselineAssignment(WagedRebalancer.java:628) 2020-09-25T05:30:02.3941919Z ... 11 more 2020-09-25T05:30:02.3942386Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:02.3943011Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:02.3943558Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:02.3944526Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:02.3945753Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1219) 2020-09-25T05:30:02.3946833Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1250) 2020-09-25T05:30:02.4028900Z at org.apache.helix.zookeeper.zkclient.ZkConnection.readData(ZkConnection.java:144) 2020-09-25T05:30:02.4030697Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1835) 2020-09-25T05:30:02.4032087Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1831) 2020-09-25T05:30:02.4033988Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:02.4035280Z ... 18 more 2020-09-25T05:30:02.4038761Z 4384384 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_7-(a6fc1d69_DEFAULT)] ERROR org.apache.helix.controller.stages.BestPossibleStateCalcStage - Event a6fc1d69_DEFAULT : Failed to calculate the new Ideal States using the rebalancer WagedRebalancer due to INVALID_REBALANCER_STATUS 2020-09-25T05:30:02.4042649Z org.apache.helix.HelixRebalanceException: Failed to get the current baseline assignment because of unexpected error. Failure Type: INVALID_REBALANCER_STATUS 2020-09-25T05:30:02.4045414Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBaselineAssignment(WagedRebalancer.java:631) 2020-09-25T05:30:02.4048846Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.globalRebalance(WagedRebalancer.java:420) 2020-09-25T05:30:02.4052648Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleAssignment(WagedRebalancer.java:354) 2020-09-25T05:30:02.4056748Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleStates(WagedRebalancer.java:327) 2020-09-25T05:30:02.4060546Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeNewIdealStates(WagedRebalancer.java:262) 2020-09-25T05:30:02.4065755Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.computeResourceBestPossibleStateWithWagedRebalancer(BestPossibleStateCalcStage.java:270) 2020-09-25T05:30:02.4072114Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.compute(BestPossibleStateCalcStage.java:126) 2020-09-25T05:30:02.4075327Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.process(BestPossibleStateCalcStage.java:85) 2020-09-25T05:30:02.4077636Z at org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68) 2020-09-25T05:30:02.4079706Z at org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777) 2020-09-25T05:30:02.4082076Z at org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128) 2020-09-25T05:30:02.4084335Z at org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407) 2020-09-25T05:30:02.4086900Z Caused by: org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:02.4089465Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:02.4091426Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1831) 2020-09-25T05:30:02.4093098Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1823) 2020-09-25T05:30:02.4094791Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.get(ZkBaseDataAccessor.java:473) 2020-09-25T05:30:02.4097056Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:260) 2020-09-25T05:30:02.4099879Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:238) 2020-09-25T05:30:02.4103099Z at org.apache.helix.controller.rebalancer.waged.AssignmentMetadataStore.getBaseline(AssignmentMetadataStore.java:69) 2020-09-25T05:30:02.4106678Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBaselineAssignment(WagedRebalancer.java:628) 2020-09-25T05:30:02.4108722Z ... 11 more 2020-09-25T05:30:02.4109201Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:02.4109825Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:02.4110371Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:02.4111343Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:02.4112583Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1219) 2020-09-25T05:30:02.4113664Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1250) 2020-09-25T05:30:02.4115211Z at org.apache.helix.zookeeper.zkclient.ZkConnection.readData(ZkConnection.java:144) 2020-09-25T05:30:02.4116820Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1835) 2020-09-25T05:30:02.4118126Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1831) 2020-09-25T05:30:02.4119910Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:02.4121147Z ... 18 more 2020-09-25T05:30:02.4181568Z 4384406 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_7-(a6fc1d69_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing DEFAULT pipeline: TestClusterStatusMonitorLifecycle0_7 for cluster [org.apache.helix.zookeeper.zkclient.ZkClient.acquireEventLock(ZkClient.java:1634), org.apache.helix.zookeeper.zkclient.ZkClient.waitForKeeperState(ZkClient.java:1611), org.apache.helix.zookeeper.zkclient.ZkClient.waitUntilConnected(ZkClient.java:1602), org.apache.helix.manager.zk.ZKHelixManager.checkConnected(ZKHelixManager.java:396), org.apache.helix.manager.zk.ZKHelixManager.getHelixDataAccessor(ZKHelixManager.java:658), org.apache.helix.controller.stages.MessageDispatchStage.processEvent(MessageDispatchStage.java:64), org.apache.helix.controller.stages.resource.ResourceMessageDispatchStage.process(ResourceMessageDispatchStage.java:33), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java :68), org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:02.4393048Z 4384438 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_7-(a6fc1d69_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing TASK pipeline: TestClusterStatusMonitorLifecycle0_7 for cluster [org.apache.helix.zookeeper.zkclient.ZkClient.acquireEventLock(ZkClient.java:1634), org.apache.helix.zookeeper.zkclient.ZkClient.waitForKeeperState(ZkClient.java:1611), org.apache.helix.zookeeper.zkclient.ZkClient.waitUntilConnected(ZkClient.java:1602), org.apache.helix.manager.zk.ZKHelixManager.checkConnected(ZKHelixManager.java:396), org.apache.helix.manager.zk.ZKHelixManager.getHelixDataAccessor(ZKHelixManager.java:658), org.apache.helix.controller.stages.MessageDispatchStage.processEvent(MessageDispatchStage.java:64), org.apache.helix.controller.stages.task.TaskMessageDispatchStage.process(TaskMessageDispatchStage.java:33), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68), org.apache.heli x.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:02.5055567Z 4384498 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_4-(e7f5acd1_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_5 is not leader for TestClusterStatusMonitorLifecycle0_4. Pipeline will not be invoked 2020-09-25T05:30:02.6375360Z 4384623 [HelixController-pipeline-task-CONTROLLER_TestClusterStatusMonitorLifecycle-(dbb7eba8_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing TASK pipeline: CONTROLLER_TestClusterStatusMonitorLifecycle for cluster [org.apache.helix.zookeeper.zkclient.ZkClient.acquireEventLock(ZkClient.java:1634), org.apache.helix.zookeeper.zkclient.ZkClient.waitForKeeperState(ZkClient.java:1611), org.apache.helix.zookeeper.zkclient.ZkClient.waitUntilConnected(ZkClient.java:1602), org.apache.helix.manager.zk.ZKHelixManager.checkConnected(ZKHelixManager.java:396), org.apache.helix.manager.zk.ZKHelixManager.getHelixDataAccessor(ZKHelixManager.java:658), org.apache.helix.controller.stages.MessageDispatchStage.processEvent(MessageDispatchStage.java:64), org.apache.helix.controller.stages.task.TaskMessageDispatchStage.process(TaskMessageDispatchStage.java:33), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68), org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:02.7223868Z 4384723 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_9-(dd1a70ea_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_8 is not leader for TestClusterStatusMonitorLifecycle0_9. Pipeline will not be invoked 2020-09-25T05:30:02.8032813Z 4384786 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_2-(7ec09f8c_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_8 is not leader for TestClusterStatusMonitorLifecycle0_2. Pipeline will not be invoked 2020-09-25T05:30:02.8498667Z 4384851 [HelixTaskExecutor-message_handle_STATE_TRANSITION] ERROR org.apache.helix.messaging.handling.HelixStateTransitionHandler - Current state of stateModel does not match the fromState in Message, CurrentState: OFFLINE, Message: STANDBY->LEADER, Partition: TestClusterStatusMonitorLifecycle0_1, from: controller_8, to: controller_8 2020-09-25T05:30:02.8528059Z 4384854 [HelixTaskExecutor-message_handle_STATE_TRANSITION] ERROR org.apache.helix.messaging.handling.HelixTask - Message execution failed. msgId: 38d888da-e24c-4fd8-a4b7-9c1d38a61290, errorMsg: org.apache.helix.messaging.handling.HelixStateTransitionHandler$HelixStateMismatchException: Current state of stateModel does not match the fromState in Message, CurrentState: OFFLINE, Message: STANDBY->LEADER, Partition: TestClusterStatusMonitorLifecycle0_1, from: controller_8, to: controller_8 2020-09-25T05:30:02.8599782Z 4384862 [HelixTaskExecutor-message_handle_STATE_TRANSITION] ERROR org.apache.helix.messaging.handling.HelixStateTransitionHandler - Skip internal error. errCode: ERROR, errMsg: Current state of stateModel does not match the fromState in Message, CurrentState: OFFLINE, Message: STANDBY->LEADER, Partition: TestClusterStatusMonitorLifecycle0_1, from: controller_8, to: controller_8 2020-09-25T05:30:02.8795913Z 4384880 [HelixController-pipeline-default-CONTROLLER_TestClusterStatusMonitorLifecycle-(4a45c82c_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_8 is not leader for CONTROLLER_TestClusterStatusMonitorLifecycle. Pipeline will not be invoked 2020-09-25T05:30:03.0941825Z 4385093 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.manager.zk.ZkBaseDataAccessor - Exception while setting path: /CONTROLLER_TestClusterStatusMonitorLifecycle/INSTANCES/controller_9/CURRENTSTATES/1000004953516c1/TestClusterStatusMonitorLifecycle0 2020-09-25T05:30:03.0945334Z org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:03.0948172Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:03.0950500Z at org.apache.helix.zookeeper.zkclient.ZkClient.writeDataReturnStat(ZkClient.java:1912) 2020-09-25T05:30:03.0952752Z at org.apache.helix.zookeeper.zkclient.ZkClient.writeDataGetStat(ZkClient.java:1932) 2020-09-25T05:30:03.0954726Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.doSet(ZkBaseDataAccessor.java:343) 2020-09-25T05:30:03.0956534Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.set(ZkBaseDataAccessor.java:322) 2020-09-25T05:30:03.0958266Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.set(ZkBaseDataAccessor.java:314) 2020-09-25T05:30:03.0959676Z at org.apache.helix.GroupCommit.commit(GroupCommit.java:149) 2020-09-25T05:30:03.0961406Z at org.apache.helix.manager.zk.ZKHelixDataAccessor.updateProperty(ZKHelixDataAccessor.java:189) 2020-09-25T05:30:03.0963809Z at org.apache.helix.manager.zk.ZKHelixDataAccessor.updateProperty(ZKHelixDataAccessor.java:177) 2020-09-25T05:30:03.0966969Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.postHandleMessage(HelixStateTransitionHandler.java:282) 2020-09-25T05:30:03.0970723Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:371) 2020-09-25T05:30:03.0973666Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) 2020-09-25T05:30:03.0975233Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) 2020-09-25T05:30:03.0976522Z at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2020-09-25T05:30:03.0977887Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2020-09-25T05:30:03.0979480Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2020-09-25T05:30:03.0980461Z at java.lang.Thread.run(Thread.java:748) 2020-09-25T05:30:03.0981085Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:03.0981710Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:03.0982261Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:03.0983229Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:03.0984471Z at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1334) 2020-09-25T05:30:03.0986308Z at org.apache.helix.zookeeper.zkclient.ZkConnection.writeDataReturnStat(ZkConnection.java:160) 2020-09-25T05:30:03.0988374Z at org.apache.helix.zookeeper.zkclient.ZkClient$12.call(ZkClient.java:1915) 2020-09-25T05:30:03.0990306Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:03.0991552Z ... 16 more 2020-09-25T05:30:03.1086375Z 4385093 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.GroupCommit - Fails to update /CONTROLLER_TestClusterStatusMonitorLifecycle/INSTANCES/controller_9/CURRENTSTATES/1000004953516c1/TestClusterStatusMonitorLifecycle0 to ZK, retry it! 2020-09-25T05:30:03.6305065Z 4385110 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.manager.zk.ZkBaseDataAccessor - Exception while setting path: /CONTROLLER_TestClusterStatusMonitorLifecycle/INSTANCES/controller_9/CURRENTSTATES/1000004953516c1/TestClusterStatusMonitorLifecycle0 2020-09-25T05:30:03.6317741Z org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:03.6320887Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:03.6325398Z at org.apache.helix.zookeeper.zkclient.ZkClient.writeDataReturnStat(ZkClient.java:1912) 2020-09-25T05:30:03.6328768Z at org.apache.helix.zookeeper.zkclient.ZkClient.writeDataGetStat(ZkClient.java:1932) 2020-09-25T05:30:03.6330926Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.doSet(ZkBaseDataAccessor.java:343) 2020-09-25T05:30:03.6332828Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.set(ZkBaseDataAccessor.java:322) 2020-09-25T05:30:03.6334672Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.set(ZkBaseDataAccessor.java:314) 2020-09-25T05:30:03.6336177Z at org.apache.helix.GroupCommit.commit(GroupCommit.java:149) 2020-09-25T05:30:03.6338080Z at org.apache.helix.manager.zk.ZKHelixDataAccessor.updateProperty(ZKHelixDataAccessor.java:189) 2020-09-25T05:30:03.6340611Z at org.apache.helix.manager.zk.ZKHelixDataAccessor.updateProperty(ZKHelixDataAccessor.java:177) 2020-09-25T05:30:03.6343879Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.postHandleMessage(HelixStateTransitionHandler.java:282) 2020-09-25T05:30:03.6347764Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:371) 2020-09-25T05:30:03.6354831Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) 2020-09-25T05:30:03.6356420Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) 2020-09-25T05:30:03.6357703Z at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2020-09-25T05:30:03.6359084Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2020-09-25T05:30:03.6360671Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2020-09-25T05:30:03.6361653Z at java.lang.Thread.run(Thread.java:748) 2020-09-25T05:30:03.6362654Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:03.6363288Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:03.6363818Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:03.6364795Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:03.6366036Z at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1334) 2020-09-25T05:30:03.6367872Z at org.apache.helix.zookeeper.zkclient.ZkConnection.writeDataReturnStat(ZkConnection.java:160) 2020-09-25T05:30:03.6369820Z at org.apache.helix.zookeeper.zkclient.ZkClient$12.call(ZkClient.java:1915) 2020-09-25T05:30:03.6371603Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:03.6372849Z ... 16 more 2020-09-25T05:30:03.6375083Z 4385111 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.GroupCommit - Fails to update /CONTROLLER_TestClusterStatusMonitorLifecycle/INSTANCES/controller_9/CURRENTSTATES/1000004953516c1/TestClusterStatusMonitorLifecycle0 to ZK, retry it! 2020-09-25T05:30:03.6378815Z 4385112 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.manager.zk.ZkBaseDataAccessor - Exception while setting path: /CONTROLLER_TestClusterStatusMonitorLifecycle/INSTANCES/controller_9/CURRENTSTATES/1000004953516c1/TestClusterStatusMonitorLifecycle0 2020-09-25T05:30:03.6382189Z org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:03.6384721Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:03.6386998Z at org.apache.helix.zookeeper.zkclient.ZkClient.writeDataReturnStat(ZkClient.java:1912) 2020-09-25T05:30:03.6389326Z at org.apache.helix.zookeeper.zkclient.ZkClient.writeDataGetStat(ZkClient.java:1932) 2020-09-25T05:30:03.6391291Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.doSet(ZkBaseDataAccessor.java:343) 2020-09-25T05:30:03.6393060Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.set(ZkBaseDataAccessor.java:322) 2020-09-25T05:30:03.6394787Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.set(ZkBaseDataAccessor.java:314) 2020-09-25T05:30:03.6396166Z at org.apache.helix.GroupCommit.commit(GroupCommit.java:149) 2020-09-25T05:30:03.6397878Z at org.apache.helix.manager.zk.ZKHelixDataAccessor.updateProperty(ZKHelixDataAccessor.java:189) 2020-09-25T05:30:03.6400260Z at org.apache.helix.manager.zk.ZKHelixDataAccessor.updateProperty(ZKHelixDataAccessor.java:177) 2020-09-25T05:30:03.6403400Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.postHandleMessage(HelixStateTransitionHandler.java:282) 2020-09-25T05:30:03.6407145Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:371) 2020-09-25T05:30:03.6409723Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) 2020-09-25T05:30:03.6411285Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) 2020-09-25T05:30:03.6412554Z at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2020-09-25T05:30:03.6413924Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2020-09-25T05:30:03.6415516Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2020-09-25T05:30:03.6416495Z at java.lang.Thread.run(Thread.java:748) 2020-09-25T05:30:03.6417114Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:03.6417738Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:03.6418286Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:03.6419254Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:03.6420493Z at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1334) 2020-09-25T05:30:03.6422311Z at org.apache.helix.zookeeper.zkclient.ZkConnection.writeDataReturnStat(ZkConnection.java:160) 2020-09-25T05:30:03.6424261Z at org.apache.helix.zookeeper.zkclient.ZkClient$12.call(ZkClient.java:1915) 2020-09-25T05:30:03.6426161Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:03.6427409Z ... 16 more 2020-09-25T05:30:03.6430408Z 4385112 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.GroupCommit - Fails to update /CONTROLLER_TestClusterStatusMonitorLifecycle/INSTANCES/controller_9/CURRENTSTATES/1000004953516c1/TestClusterStatusMonitorLifecycle0 to ZK, retry it! 2020-09-25T05:30:03.6433665Z 4385112 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.messaging.handling.HelixStateTransitionHandler - Error when updating current-state 2020-09-25T05:30:03.6436363Z org.apache.helix.HelixException: Fails to persist current state back to ZK for resource TestClusterStatusMonitorLifecycle0 partition: TestClusterStatusMonitorLifecycle0_1 2020-09-25T05:30:03.6439537Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.postHandleMessage(HelixStateTransitionHandler.java:284) 2020-09-25T05:30:03.6444025Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:371) 2020-09-25T05:30:03.6446639Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) 2020-09-25T05:30:03.6448666Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) 2020-09-25T05:30:03.6449977Z at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2020-09-25T05:30:03.6451353Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2020-09-25T05:30:03.6452927Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2020-09-25T05:30:03.6454596Z at java.lang.Thread.run(Thread.java:748) 2020-09-25T05:30:03.6457620Z 4385126 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_1-(0485645c_DEFAULT)] ERROR org.apache.helix.controller.rebalancer.waged.WagedRebalancer - Failed to calculate the new assignments. 2020-09-25T05:30:03.6460772Z org.apache.helix.HelixRebalanceException: Failed to get the current best possible assignment because of unexpected error. Failure Type: INVALID_REBALANCER_STATUS 2020-09-25T05:30:03.6469634Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBestPossibleAssignment(WagedRebalancer.java:664) 2020-09-25T05:30:03.6473230Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.partialRebalance(WagedRebalancer.java:516) 2020-09-25T05:30:03.6476920Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleAssignment(WagedRebalancer.java:357) 2020-09-25T05:30:03.6481180Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleStates(WagedRebalancer.java:327) 2020-09-25T05:30:03.6487343Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeNewIdealStates(WagedRebalancer.java:262) 2020-09-25T05:30:03.6492487Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.computeResourceBestPossibleStateWithWagedRebalancer(BestPossibleStateCalcStage.java:270) 2020-09-25T05:30:03.6503197Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.compute(BestPossibleStateCalcStage.java:126) 2020-09-25T05:30:03.6506286Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.process(BestPossibleStateCalcStage.java:85) 2020-09-25T05:30:03.6508860Z at org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68) 2020-09-25T05:30:03.6510945Z at org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777) 2020-09-25T05:30:03.6513311Z at org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128) 2020-09-25T05:30:03.6515572Z at org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407) 2020-09-25T05:30:03.6518509Z Caused by: org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:03.6521106Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:03.6523261Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1831) 2020-09-25T05:30:03.6524936Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1823) 2020-09-25T05:30:03.6526949Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.get(ZkBaseDataAccessor.java:473) 2020-09-25T05:30:03.6529249Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:260) 2020-09-25T05:30:03.6532402Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:238) 2020-09-25T05:30:03.6537797Z at org.apache.helix.controller.rebalancer.waged.AssignmentMetadataStore.getBestPossibleAssignment(AssignmentMetadataStore.java:84) 2020-09-25T05:30:03.6543630Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBestPossibleAssignment(WagedRebalancer.java:661) 2020-09-25T05:30:03.6546125Z ... 11 more 2020-09-25T05:30:03.6546606Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:03.6547245Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:03.6547915Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:03.6548901Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:03.6550325Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1219) 2020-09-25T05:30:03.6551683Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1250) 2020-09-25T05:30:03.6553236Z at org.apache.helix.zookeeper.zkclient.ZkConnection.readData(ZkConnection.java:144) 2020-09-25T05:30:03.6554941Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1835) 2020-09-25T05:30:03.6556502Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1831) 2020-09-25T05:30:03.6558571Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:03.6560322Z ... 18 more 2020-09-25T05:30:03.6563702Z 4385141 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_1-(0485645c_DEFAULT)] ERROR org.apache.helix.controller.stages.BestPossibleStateCalcStage - Event 0485645c_DEFAULT : Failed to calculate the new Ideal States using the rebalancer WagedRebalancer due to INVALID_REBALANCER_STATUS 2020-09-25T05:30:03.6567213Z org.apache.helix.HelixRebalanceException: Failed to get the current best possible assignment because of unexpected error. Failure Type: INVALID_REBALANCER_STATUS 2020-09-25T05:30:03.6570034Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBestPossibleAssignment(WagedRebalancer.java:664) 2020-09-25T05:30:03.6573649Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.partialRebalance(WagedRebalancer.java:516) 2020-09-25T05:30:03.6577735Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleAssignment(WagedRebalancer.java:357) 2020-09-25T05:30:03.6581774Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeBestPossibleStates(WagedRebalancer.java:327) 2020-09-25T05:30:03.6585515Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.computeNewIdealStates(WagedRebalancer.java:262) 2020-09-25T05:30:03.6590825Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.computeResourceBestPossibleStateWithWagedRebalancer(BestPossibleStateCalcStage.java:270) 2020-09-25T05:30:03.6595681Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.compute(BestPossibleStateCalcStage.java:126) 2020-09-25T05:30:03.6598708Z at org.apache.helix.controller.stages.BestPossibleStateCalcStage.process(BestPossibleStateCalcStage.java:85) 2020-09-25T05:30:03.6601025Z at org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68) 2020-09-25T05:30:03.6603090Z at org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777) 2020-09-25T05:30:03.6605464Z at org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128) 2020-09-25T05:30:03.6607718Z at org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407) 2020-09-25T05:30:03.6610428Z Caused by: org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:03.6612993Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694) 2020-09-25T05:30:03.6614959Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1831) 2020-09-25T05:30:03.6616633Z at org.apache.helix.zookeeper.zkclient.ZkClient.readData(ZkClient.java:1823) 2020-09-25T05:30:03.6618324Z at org.apache.helix.manager.zk.ZkBaseDataAccessor.get(ZkBaseDataAccessor.java:473) 2020-09-25T05:30:03.6620590Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:260) 2020-09-25T05:30:03.6623402Z at org.apache.helix.manager.zk.ZkBucketDataAccessor.compressedBucketRead(ZkBucketDataAccessor.java:238) 2020-09-25T05:30:03.6627170Z at org.apache.helix.controller.rebalancer.waged.AssignmentMetadataStore.getBestPossibleAssignment(AssignmentMetadataStore.java:84) 2020-09-25T05:30:03.6631579Z at org.apache.helix.controller.rebalancer.waged.WagedRebalancer.getBestPossibleAssignment(WagedRebalancer.java:661) 2020-09-25T05:30:03.6633745Z ... 11 more 2020-09-25T05:30:03.6634214Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:03.6634827Z at java.lang.Object.wait(Native Method) 2020-09-25T05:30:03.6635377Z at java.lang.Object.wait(Object.java:502) 2020-09-25T05:30:03.6636350Z at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1411) 2020-09-25T05:30:03.6637591Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1219) 2020-09-25T05:30:03.6640034Z at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1250) 2020-09-25T05:30:03.6645357Z at org.apache.helix.zookeeper.zkclient.ZkConnection.readData(ZkConnection.java:144) 2020-09-25T05:30:03.6647005Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1835) 2020-09-25T05:30:03.6648319Z at org.apache.helix.zookeeper.zkclient.ZkClient$11.call(ZkClient.java:1831) 2020-09-25T05:30:03.6650112Z at org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1678) 2020-09-25T05:30:03.6651358Z ... 18 more 2020-09-25T05:30:03.6654589Z 4385144 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.messaging.handling.HelixTask - Exception while executing a message. org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException msgId: 2b874ac8-1751-420b-aa10-4a56f10ce659 type: STATE_TRANSITION 2020-09-25T05:30:03.6659649Z org.apache.helix.zookeeper.zkclient.exception.ZkInterruptedException: java.lang.InterruptedException 2020-09-25T05:30:03.6662158Z at org.apache.helix.zookeeper.zkclient.ZkClient.acquireEventLock(ZkClient.java:1634) 2020-09-25T05:30:03.6664569Z at org.apache.helix.zookeeper.zkclient.ZkClient.waitForKeeperState(ZkClient.java:1611) 2020-09-25T05:30:03.6666831Z at org.apache.helix.zookeeper.zkclient.ZkClient.waitUntilConnected(ZkClient.java:1602) 2020-09-25T05:30:03.6670100Z at org.apache.helix.manager.zk.ZKHelixManager.cleanupCallbackHandlers(ZKHelixManager.java:873) 2020-09-25T05:30:03.6672283Z at org.apache.helix.manager.zk.ZKHelixManager.disconnect(ZKHelixManager.java:823) 2020-09-25T05:30:03.6674710Z at org.apache.helix.participant.DistClusterControllerStateModel.reset(DistClusterControllerStateModel.java:116) 2020-09-25T05:30:03.6678379Z at org.apache.helix.participant.AbstractHelixLeaderStandbyStateModel.rollbackOnError(AbstractHelixLeaderStandbyStateModel.java:86) 2020-09-25T05:30:03.6682476Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.postHandleMessage(HelixStateTransitionHandler.java:297) 2020-09-25T05:30:03.6686219Z at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:371) 2020-09-25T05:30:03.6688793Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) 2020-09-25T05:30:03.6690357Z at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) 2020-09-25T05:30:03.6691810Z at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2020-09-25T05:30:03.6693189Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2020-09-25T05:30:03.6694763Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2020-09-25T05:30:03.6695749Z at java.lang.Thread.run(Thread.java:748) 2020-09-25T05:30:03.6696377Z Caused by: java.lang.InterruptedException 2020-09-25T05:30:03.6698412Z at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1223) 2020-09-25T05:30:03.6701102Z at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340) 2020-09-25T05:30:03.6703161Z at org.apache.helix.zookeeper.zkclient.ZkClient.acquireEventLock(ZkClient.java:1632) 2020-09-25T05:30:03.6704317Z ... 14 more 2020-09-25T05:30:03.6707286Z 4385145 [TaskJobPurgeWorker-TestClusterStatusMonitorLifecycle0_1] ERROR org.apache.helix.controller.pipeline.AbstractAsyncBaseStage - Failed to process TASK::TaskGarbageCollectionStage asynchronously 2020-09-25T05:30:03.6710103Z org.apache.helix.HelixException: HelixManager (ZkClient) is not connected. Call HelixManager#connect() 2020-09-25T05:30:03.6711842Z at org.apache.helix.manager.zk.ZKHelixManager.checkConnected(ZKHelixManager.java:388) 2020-09-25T05:30:03.6714000Z at org.apache.helix.manager.zk.ZKHelixManager.getHelixDataAccessor(ZKHelixManager.java:658) 2020-09-25T05:30:03.6716078Z at org.apache.helix.task.TaskUtil.workflowGarbageCollection(TaskUtil.java:1118) 2020-09-25T05:30:03.6718492Z at org.apache.helix.controller.stages.TaskGarbageCollectionStage.execute(TaskGarbageCollectionStage.java:126) 2020-09-25T05:30:03.6721173Z at org.apache.helix.controller.pipeline.AbstractAsyncBaseStage$1.run(AbstractAsyncBaseStage.java:47) 2020-09-25T05:30:03.6723340Z at org.apache.helix.controller.GenericHelixController$3.handleEvent(GenericHelixController.java:654) 2020-09-25T05:30:03.6725333Z at org.apache.helix.controller.GenericHelixController$3.handleEvent(GenericHelixController.java:650) 2020-09-25T05:30:03.6727151Z at org.apache.helix.common.DedupEventProcessor.run(DedupEventProcessor.java:61) 2020-09-25T05:30:03.6740087Z 4385145 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(3e22ed78_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing TASK pipeline: TestClusterStatusMonitorLifecycle0_1 for cluster [org.apache.helix.manager.zk.ZKHelixManager.checkConnected(ZKHelixManager.java:388), org.apache.helix.manager.zk.ZKHelixManager.getHelixDataAccessor(ZKHelixManager.java:658), org.apache.helix.controller.stages.MessageDispatchStage.processEvent(MessageDispatchStage.java:64), org.apache.helix.controller.stages.task.TaskMessageDispatchStage.process(TaskMessageDispatchStage.java:33), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68), org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.ru n(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:03.6754003Z 4385146 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(a70bc871_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_9 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:30:03.6768901Z 4385146 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_1-(0485645c_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing DEFAULT pipeline: TestClusterStatusMonitorLifecycle0_1 for cluster [org.apache.helix.manager.zk.ZKHelixManager.checkConnected(ZKHelixManager.java:388), org.apache.helix.manager.zk.ZKHelixManager.getHelixDataAccessor(ZKHelixManager.java:658), org.apache.helix.controller.stages.MessageDispatchStage.processEvent(MessageDispatchStage.java:64), org.apache.helix.controller.stages.resource.ResourceMessageDispatchStage.process(ResourceMessageDispatchStage.java:33), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68), org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$Clu sterEventProcessor.run(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:03.6783257Z 4385146 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(c5e03106_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_9 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:30:03.6788441Z 4385156 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(c5f40b5a_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_9 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:30:03.6793735Z 4385156 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_1-(bd4172dc_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Cluster manager: controller_9 is not leader for TestClusterStatusMonitorLifecycle0_1. Pipeline will not be invoked 2020-09-25T05:30:03.6799700Z 4385158 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.messaging.handling.HelixTask - Message execution failed. msgId: 2b874ac8-1751-420b-aa10-4a56f10ce659, errorMsg: java.lang.InterruptedException 2020-09-25T05:30:03.6804249Z 4385172 [HelixTaskExecutor-message_handle_thread_37853] ERROR org.apache.helix.messaging.handling.HelixStateTransitionHandler - Skip internal error. errCode: ERROR, errMsg: java.lang.InterruptedException 2020-09-25T05:30:03.6829124Z 4385339 [HelixController-pipeline-default-TestClusterStatusMonitorLifecycle0_0-(2cae692c_DEFAULT)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing DEFAULT pipeline: TestClusterStatusMonitorLifecycle0_0 for cluster [org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694), org.apache.helix.zookeeper.zkclient.ZkClient.getChildren(ZkClient.java:1047), org.apache.helix.zookeeper.zkclient.ZkClient.getChildren(ZkClient.java:1040), org.apache.helix.manager.zk.ZkBaseDataAccessor.getChildNames(ZkBaseDataAccessor.java:669), org.apache.helix.manager.zk.ZKHelixDataAccessor.getChildNames(ZKHelixDataAccessor.java:394), org.apache.helix.common.caches.PropertyCache.genSelectiveUpdateInput(PropertyCache.java:133), org.apache.helix.common.caches.PropertyCache.doRefreshWithSelectiveUpdate(PropertyCache.java:174), org.apache.helix.common.caches.PropertyCache.refresh(PropertyCache.java:158), org.apache.helix .controller.dataproviders.BaseControllerDataProvider.refreshLiveInstances(BaseControllerDataProvider.java:256), org.apache.helix.controller.dataproviders.BaseControllerDataProvider.doRefresh(BaseControllerDataProvider.java:330), org.apache.helix.controller.dataproviders.ResourceControllerDataProvider.refresh(ResourceControllerDataProvider.java:143), org.apache.helix.controller.stages.ReadClusterDataStage.process(ReadClusterDataStage.java:63), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68), org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:03.6873566Z 4385341 [HelixController-pipeline-task-TestClusterStatusMonitorLifecycle0_0-(2cae692c_TASK)] ERROR org.apache.helix.controller.GenericHelixController - Exception while executing TASK pipeline: TestClusterStatusMonitorLifecycle0_0 for cluster [org.apache.helix.zookeeper.zkclient.ZkClient.retryUntilConnected(ZkClient.java:1694), org.apache.helix.zookeeper.zkclient.ZkClient.getChildren(ZkClient.java:1047), org.apache.helix.zookeeper.zkclient.ZkClient.getChildren(ZkClient.java:1040), org.apache.helix.manager.zk.ZkBaseDataAccessor.getChildNames(ZkBaseDataAccessor.java:669), org.apache.helix.manager.zk.ZKHelixDataAccessor.getChildNames(ZKHelixDataAccessor.java:394), org.apache.helix.common.caches.PropertyCache.genSelectiveUpdateInput(PropertyCache.java:133), org.apache.helix.common.caches.PropertyCache.doRefreshWithSelectiveUpdate(PropertyCache.java:174), org.apache.helix.common.caches.PropertyCache.refresh(PropertyCache.java:158), org.apache.helix.controll er.dataproviders.BaseControllerDataProvider.refreshInstanceConfigs(BaseControllerDataProvider.java:269), org.apache.helix.controller.dataproviders.BaseControllerDataProvider.doRefresh(BaseControllerDataProvider.java:331), org.apache.helix.controller.dataproviders.WorkflowControllerDataProvider.refresh(WorkflowControllerDataProvider.java:88), org.apache.helix.controller.stages.ReadClusterDataStage.process(ReadClusterDataStage.java:63), org.apache.helix.controller.pipeline.Pipeline.handle(Pipeline.java:68), org.apache.helix.controller.GenericHelixController.handleEvent(GenericHelixController.java:777), org.apache.helix.controller.GenericHelixController.access$500(GenericHelixController.java:128), org.apache.helix.controller.GenericHelixController$ClusterEventProcessor.run(GenericHelixController.java:1407)]. Will not continue to next pipeline 2020-09-25T05:30:34.5107540Z 4416507 [ZkClient-EventThread-54905-localhost:2183] ERROR org.apache.helix.manager.zk.ZKHelixManager - fail to connect zkserver: localhost:2183 in 60000ms. expiredSessionId: 100000495350e0f, clusterName: TestSessionExpiryInTransition_testSessionExpiryInTransition 2020-09-25T05:31:04.1459039Z 4445535 [TestNGInvoker-testClusterStatusMonitorLifecycle()] ERROR org.apache.helix.TestHelper - verifier time out, consider try longer timeout, stack trace[java.lang.Thread.getStackTrace(Thread.java:1559), org.apache.helix.TestHelper.verify(TestHelper.java:809), org.apache.helix.monitoring.TestClusterStatusMonitorLifecycle.testClusterStatusMonitorLifecycle(TestClusterStatusMonitorLifecycle.java:298), sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method), sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62), sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43), java.lang.reflect.Method.invoke(Method.java:498), org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:76), org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46), org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37), java.util.concurrent.Executors$RunnableA dapter.call(Executors.java:511), java.util.concurrent.FutureTask.run(FutureTask.java:266), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624), java.lang.Thread.run(Thread.java:748)] 2020-09-25T05:31:04.1472049Z END TestClusterStatusMonitorLifecycle testClusterStatusMonitorLifecycle at Fri Sep 25 05:31:03 UTC 2020, took: 64819ms. 2020-09-25T05:31:04.1473697Z AfterClass: TestClusterStatusMonitorLifecycle of TestClusterStatusMonitorLifeCycle called. 2020-09-25T05:31:04.1474658Z Cleaning up... 2020-09-25T05:31:04.1475248Z END TestClusterStatusMonitorLifecycle at Fri Sep 25 05:31:03 UTC 2020 2020-09-25T05:31:04.1476288Z AfterClass:TestClusterStatusMonitorLifecycle afterclass of ZkTestBase called! ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
