[ 
https://issues.apache.org/jira/browse/HDDS-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

George Jahad updated HDDS-8708:
-------------------------------
    Description: 
We have some tests that can be scaled but because they run inside a 
minicluster, they can't scale too much.

 

Instead we need some tests on a real cluster.

 

 

  was:
I have a parameterized test here 
https://github.com/apache/ozone/blob/f758ab2cd96d92d2d73d51286bdd3c87840bceec/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOMRatisSnapshots.java#L177-L181

It allows you to set the number of snapshots to be created before 
bootstrapping, (but each one only contains 10 more keys than the previous.)  
I've tried it up to a thousand and it passes, (if you increase the timeouts.)  
But because it all runs inside a minicluster, we probably can't increase it a 
lot more than that.

 

 


> Stress test bootstrapping with thousands of snapshots and millions of keys.
> ---------------------------------------------------------------------------
>
>                 Key: HDDS-8708
>                 URL: https://issues.apache.org/jira/browse/HDDS-8708
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: George Jahad
>            Priority: Major
>
> We have some tests that can be scaled but because they run inside a 
> minicluster, they can't scale too much.
>  
> Instead we need some tests on a real cluster.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to