[ 
https://issues.apache.org/jira/browse/HDDS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Doroszlai updated HDDS-8476:
-----------------------------------
    Description: 
{{TestScmHAFinalization}} failed in CI due to:

{code:title=https://github.com/adoroszlai/ozone-build-results/blob/master/2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt}
2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
(ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedLRUCache is not closed 
properly
2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
(ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedBloomFilter is not 
closed properly
2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
(ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedColumnFamilyOptions is 
not closed properly
{code}

No allocation stack trace available.  Log indicates more DB instances are added 
to the cache than are removed:

{code}
$ grep -c 'Added db' 
2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt
                        
34

$ grep -c 'Removed db' 
2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt
13
{code}

All 13 DBs are added twice, removed only once.  And there are 8 extra DBs never 
removed.

CC [~duongnguyen], [~erose], [~sammichen]

  was:
{{TestScmHAFinalization}} failed in CI due to:

{code:title=https://github.com/adoroszlai/ozone-build-results/blob/master/2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt}
2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
(ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedLRUCache is not closed 
properly
2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
(ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedBloomFilter is not 
closed properly
2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
(ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedColumnFamilyOptions is 
not closed properly
{code}

No allocation stack trace available.  Log indicates more DB instances are added 
to the cache than are removed:

{code}
$ grep -c 'Added db' 
2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt
                        
34

$ grep -c 'Removed db' 
2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt
13
{code}

All 13 DBs are added twice, removed only once.  And there are 8 extra DBs never 
removed.


> DatanodeStore left in cache during SCM HA finalization
> ------------------------------------------------------
>
>                 Key: HDDS-8476
>                 URL: https://issues.apache.org/jira/browse/HDDS-8476
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: SCM HA, upgrade
>            Reporter: Attila Doroszlai
>            Priority: Major
>              Labels: intermittent
>
> {{TestScmHAFinalization}} failed in CI due to:
> {code:title=https://github.com/adoroszlai/ozone-build-results/blob/master/2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt}
> 2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
> (ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedLRUCache is not 
> closed properly
> 2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
> (ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedBloomFilter is not 
> closed properly
> 2023-04-21 13:41:53,483 [Finalizer] WARN  managed.ManagedRocksObjectUtils 
> (ManagedRocksObjectUtils.java:assertClosed(54)) - ManagedColumnFamilyOptions 
> is not closed properly
> {code}
> No allocation stack trace available.  Log indicates more DB instances are 
> added to the cache than are removed:
> {code}
> $ grep -c 'Added db' 
> 2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt
>                         
> 34
> $ grep -c 'Removed db' 
> 2023/04/21/21768/it-hdds/hadoop-ozone/integration-test/org.apache.hadoop.hdds.upgrade.TestScmHAFinalization-output.txt
> 13
> {code}
> All 13 DBs are added twice, removed only once.  And there are 8 extra DBs 
> never removed.
> CC [~duongnguyen], [~erose], [~sammichen]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to