[ 
https://issues.apache.org/jira/browse/IGNITE-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158507#comment-17158507
 ] 

Ignite TC Bot commented on IGNITE-13171:
----------------------------------------

{panel:title=Branch: [pull/7962/head] Base: [master] : No blockers 
found!|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}{panel}
{panel:title=Branch: [pull/7962/head] Base: [master] : New Tests 
(82)|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}
{color:#00008b}PDS 4{color} [[tests 
3|https://ci.ignite.apache.org/viewLog.html?buildId=5463848]]
* {color:#013220}IgnitePdsTestSuite4: 
RebalanceCancellationTest.testComplexCompatibilityInMemory - PASSED{color}
* {color:#013220}IgnitePdsTestSuite4: 
RebalanceAfterResettingLostPartitionTest.testRebalanceAfterPartitionsWereLost - 
PASSED{color}
* {color:#013220}IgnitePdsTestSuite4: 
IgnitePdsConsistencyOnDelayedPartitionOwning.checkConsistencyNodeLeft - 
PASSED{color}

{color:#00008b}MVCC Cache 7{color} [[tests 
30|https://ci.ignite.apache.org/viewLog.html?buildId=5462553]]
* {color:#013220}IgniteCacheMvccTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testPreloadManyNodes - 
PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testManualPreload - 
PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testAutomaticPreload - 
PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testManualPreloadSyncMode - 
PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testDelayedPreload - 
PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testAutomaticPreloadWithEmptyCache
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testLateAffinityChangeDuringExchange
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testConsistencyAfterBaselineNodeStopAndRemoval_WithRestart
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testPartitionConsistencyDuringRebalanceAndConcurrentUpdates_RemoveQueueCleared
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testPartitionConsistencyDuringRebalanceAndConcurrentUpdates_SameAffinityPME
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testConsistencyAfterBaselineNodeStopAndRemoval_WithRestartAndSkipCheckpoint
 - PASSED{color}
... and 19 new tests

{color:#00008b}MVCC PDS 4{color} [[tests 
3|https://ci.ignite.apache.org/viewLog.html?buildId=5462559]]
* {color:#013220}IgnitePdsMvccTestSuite4: 
RebalanceCancellationTest.testComplexCompatibilityInMemory - PASSED{color}
* {color:#013220}IgnitePdsMvccTestSuite4: 
RebalanceAfterResettingLostPartitionTest.testRebalanceAfterPartitionsWereLost - 
PASSED{color}
* {color:#013220}IgnitePdsMvccTestSuite4: 
IgnitePdsConsistencyOnDelayedPartitionOwning.checkConsistencyNodeLeft - 
PASSED{color}

{color:#00008b}Cache 7{color} [[tests 
30|https://ci.ignite.apache.org/viewLog.html?buildId=5463530]]
* {color:#013220}IgniteCacheTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testAutomaticPreloadWithEmptyCache
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testPreloadManyNodes - 
PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testManualPreload - 
PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testAutomaticPreload - 
PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testManualPreloadSyncMode - 
PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
GridCacheDhtPreloadDelayedWithPersistenceSelfTest.testDelayedPreload - 
PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testPartitionConsistencyDuringRebalanceAndConcurrentUpdates_CheckpointDuringRebalance
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testPartitionConsistencyDuringRebalanceConcurrentlyWithTopologyChange_CacheStart
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testConsistencyAfterBaselineNodeStopAndRemoval
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testPartitionConsistencyDuringRebalanceAndConcurrentUpdates_TxDuringPME
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite7: 
AtomicVolatilePartitionCounterStateConsistencyTest.testPartitionConsistencyDuringRebalanceConcurrentlyWithTopologyChange_DemanderRestart
 - PASSED{color}
... and 19 new tests

{color:#00008b}Cache 9{color} [[tests 
4|https://ci.ignite.apache.org/viewLog.html?buildId=5462520]]
* {color:#013220}IgniteCacheTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetPut
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetAllAsyncPutAllAsync
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetAsyncPutAsync
 - PASSED{color}
* {color:#013220}IgniteCacheTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetAllPutAll
 - PASSED{color}

{color:#00008b}MVCC Cache 9{color} [[tests 
4|https://ci.ignite.apache.org/viewLog.html?buildId=5462555]]
* {color:#013220}IgniteCacheMvccTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetPut
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetAsyncPutAsync
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetAllPutAll
 - PASSED{color}
* {color:#013220}IgniteCacheMvccTestSuite9: 
GridCacheVersionGenerationWithCacheStorageTest.testCacheVersionGenerationWithCacheStoreGetAllAsyncPutAllAsync
 - PASSED{color}

{color:#00008b}Service Grid{color} [[tests 
4|https://ci.ignite.apache.org/viewLog.html?buildId=5462545]]
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.topologyVersion[Test event=IgniteBiTuple 
[val1=DiscoveryEvent [evtNode=9e5697ac-e7b3-4fc0-aaf6-d3548e360b39, topVer=0, 
nodeId8=b0662be5, msg=, type=NODE_JOINED, tstamp=1594743705631], 
val2=AffinityTopologyVersion [topVer=8535038780670787463, minorTopVer=0]]] - 
PASSED{color}
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.requestId[Test event=IgniteBiTuple 
[val1=DiscoveryEvent [evtNode=9e5697ac-e7b3-4fc0-aaf6-d3548e360b39, topVer=0, 
nodeId8=b0662be5, msg=, type=NODE_JOINED, tstamp=1594743705631], 
val2=AffinityTopologyVersion [topVer=8535038780670787463, minorTopVer=0]]] - 
PASSED{color}
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.topologyVersion[Test event=IgniteBiTuple 
[val1=DiscoveryCustomEvent [customMsg=ServiceChangeBatchRequest 
[id=ffbbb2e4371-2c152fc8-6736-4a84-83f0-860f7c242d35, reqs=SingletonList 
[ServiceUndeploymentRequest []]], affTopVer=null, super=DiscoveryEvent 
[evtNode=5aab4222-dc7d-4d90-a8d7-3d32de0ded23, topVer=0, nodeId8=5aab4222, 
msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1594743705631]], 
val2=AffinityTopologyVersion [topVer=-6991647483046712127, minorTopVer=0]]] - 
PASSED{color}
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.requestId[Test event=IgniteBiTuple 
[val1=DiscoveryCustomEvent [customMsg=ServiceChangeBatchRequest 
[id=ffbbb2e4371-2c152fc8-6736-4a84-83f0-860f7c242d35, reqs=SingletonList 
[ServiceUndeploymentRequest []]], affTopVer=null, super=DiscoveryEvent 
[evtNode=5aab4222-dc7d-4d90-a8d7-3d32de0ded23, topVer=0, nodeId8=5aab4222, 
msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1594743705631]], 
val2=AffinityTopologyVersion [topVer=-6991647483046712127, minorTopVer=0]]] - 
PASSED{color}

{color:#00008b}Service Grid (legacy mode){color} [[tests 
4|https://ci.ignite.apache.org/viewLog.html?buildId=5462546]]
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.topologyVersion[Test event=IgniteBiTuple 
[val1=DiscoveryEvent [evtNode=afc033ee-f625-47a2-99e4-1668287aafe7, topVer=0, 
nodeId8=f737cc40, msg=, type=NODE_JOINED, tstamp=1594743624971], 
val2=AffinityTopologyVersion [topVer=-2415515030520273624, minorTopVer=0]]] - 
PASSED{color}
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.requestId[Test event=IgniteBiTuple 
[val1=DiscoveryEvent [evtNode=afc033ee-f625-47a2-99e4-1668287aafe7, topVer=0, 
nodeId8=f737cc40, msg=, type=NODE_JOINED, tstamp=1594743624971], 
val2=AffinityTopologyVersion [topVer=-2415515030520273624, minorTopVer=0]]] - 
PASSED{color}
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.topologyVersion[Test event=IgniteBiTuple 
[val1=DiscoveryCustomEvent [customMsg=ServiceChangeBatchRequest 
[id=f05902e4371-71b5dac8-70eb-4f0a-8fa7-2fd7560e0034, reqs=SingletonList 
[ServiceUndeploymentRequest []]], affTopVer=null, super=DiscoveryEvent 
[evtNode=649103e4-6abe-4b76-bd91-10dbda4401a5, topVer=0, nodeId8=649103e4, 
msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1594743624971]], 
val2=AffinityTopologyVersion [topVer=-2819765575624027912, minorTopVer=0]]] - 
PASSED{color}
* {color:#013220}IgniteServiceGridTestSuite: 
ServiceDeploymentProcessIdSelfTest.requestId[Test event=IgniteBiTuple 
[val1=DiscoveryCustomEvent [customMsg=ServiceChangeBatchRequest 
[id=f05902e4371-71b5dac8-70eb-4f0a-8fa7-2fd7560e0034, reqs=SingletonList 
[ServiceUndeploymentRequest []]], affTopVer=null, super=DiscoveryEvent 
[evtNode=649103e4-6abe-4b76-bd91-10dbda4401a5, topVer=0, nodeId8=649103e4, 
msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1594743624971]], 
val2=AffinityTopologyVersion [topVer=-2819765575624027912, minorTopVer=0]]] - 
PASSED{color}

{panel}
[TeamCity *--> Run :: All* 
Results|https://ci.ignite.apache.org/viewLog.html?buildId=5462566&buildTypeId=IgniteTests24Java8_RunAll]

> Proper handling of a rebalancing with disabled WAL
> --------------------------------------------------
>
>                 Key: IGNITE-13171
>                 URL: https://issues.apache.org/jira/browse/IGNITE-13171
>             Project: Ignite
>          Issue Type: Bug
>    Affects Versions: 2.8
>            Reporter: Alexey Scherbakov
>            Assignee: Alexey Scherbakov
>            Priority: Major
>             Fix For: 2.9
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Current implementation of a optimized rebalancing with disabled WAL used when 
> all local partitions are MOVING and persistence is enabled has multiple flaws:
>  # There are races between concurrent topology change and partition owning 
> after a checkpoint causing consistency issues.
>  # Partitions will not be owned after a topology has changed and new topology 
> version is compatible with previous.
> This is the reason for flaky tests [1] [2]
> [1] 
> [https://ci.ignite.apache.org/project.html?projectId=IgniteTests24Java8&testNameId=1140020093875959306&branch=%3Cdefault%3E&tab=testDetails]
> [2] 
> https://ci.ignite.apache.org/project.html?projectId=IgniteTests24Java8&testNameId=7421637930905964922&branch=%3Cdefault%3E&tab=testDetails



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to