[jira] [Commented] (HDFS-15004) Refactor TestBalancer for faster execution.
[ https://issues.apache.org/jira/browse/HDFS-15004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541338#comment-17541338 ] Masatake Iwasaki commented on HDFS-15004: - updated the target version for preparing 2.10.2 release. > Refactor TestBalancer for faster execution. > --- > > Key: HDFS-15004 > URL: https://issues.apache.org/jira/browse/HDFS-15004 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs, test >Affects Versions: 2.10.0 >Reporter: Konstantin Shvachko >Priority: Major > > {{TestBalancer}} is a big test by itself, it is also a part of many other > tests. Running these tests involves spinning of {{MiniDFSCluter}} and > shutting it down for every test case, which is inefficient. Many of the test > cases can run using the same instance of {{MiniDFSCluter}}, but not all of > them. Would be good to refactor the tests to optimize their running time. -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-15004) Refactor TestBalancer for faster execution.
[ https://issues.apache.org/jira/browse/HDFS-15004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283835#comment-17283835 ] Simbarashe Dzinamarira commented on HDFS-15004: --- [~ahussein], sorry I haven't found bandwidth to dig properly into this. A preliminary analysis I did last year suggested the number of test cases that were straight forward to optimize were limited. However with a more look thorough investigation and refactor perhaps more can be done. I've marked the ticket as unassigned for now. > Refactor TestBalancer for faster execution. > --- > > Key: HDFS-15004 > URL: https://issues.apache.org/jira/browse/HDFS-15004 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs, test >Affects Versions: 2.10.0 >Reporter: Konstantin Shvachko >Priority: Major > > {{TestBalancer}} is a big test by itself, it is also a part of many other > tests. Running these tests involves spinning of {{MiniDFSCluter}} and > shutting it down for every test case, which is inefficient. Many of the test > cases can run using the same instance of {{MiniDFSCluter}}, but not all of > them. Would be good to refactor the tests to optimize their running time. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-15004) Refactor TestBalancer for faster execution.
[ https://issues.apache.org/jira/browse/HDFS-15004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283797#comment-17283797 ] Ahmed Hussein commented on HDFS-15004: -- [~simbadzina], is there any update on this jira? > Refactor TestBalancer for faster execution. > --- > > Key: HDFS-15004 > URL: https://issues.apache.org/jira/browse/HDFS-15004 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs, test >Affects Versions: 2.10.0 >Reporter: Konstantin Shvachko >Assignee: Simbarashe Dzinamarira >Priority: Major > > {{TestBalancer}} is a big test by itself, it is also a part of many other > tests. Running these tests involves spinning of {{MiniDFSCluter}} and > shutting it down for every test case, which is inefficient. Many of the test > cases can run using the same instance of {{MiniDFSCluter}}, but not all of > them. Would be good to refactor the tests to optimize their running time. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-15004) Refactor TestBalancer for faster execution.
[ https://issues.apache.org/jira/browse/HDFS-15004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17190564#comment-17190564 ] Masatake Iwasaki commented on HDFS-15004: - updated the target version for preparing 2.10.1 release. > Refactor TestBalancer for faster execution. > --- > > Key: HDFS-15004 > URL: https://issues.apache.org/jira/browse/HDFS-15004 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs, test >Affects Versions: 2.10.0 >Reporter: Konstantin Shvachko >Assignee: Simbarashe Dzinamarira >Priority: Major > > {{TestBalancer}} is a big test by itself, it is also a part of many other > tests. Running these tests involves spinning of {{MiniDFSCluter}} and > shutting it down for every test case, which is inefficient. Many of the test > cases can run using the same instance of {{MiniDFSCluter}}, but not all of > them. Would be good to refactor the tests to optimize their running time. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org