[jira] [Commented] (HBASE-23806) Provide a much faster and efficient alternate option to maven and surefire for running tests.
[ https://issues.apache.org/jira/browse/HBASE-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109348#comment-17109348 ] Mark Robert Miller commented on HBASE-23806: I’m done with my project. I was originally going to try and kind of document and share my trail, but it did not really pan out. My intention was that once the test suite was seen at another level, it might just be too tempting to take some benefit from that example of what can be done. Really though, the main benefit was for me, for general knowledge and so that I could understand how to do a couple things in the code with confidence. > Provide a much faster and efficient alternate option to maven and surefire > for running tests. > - > > Key: HBASE-23806 > URL: https://issues.apache.org/jira/browse/HBASE-23806 > Project: HBase > Issue Type: Wish >Reporter: Mark Robert Miller >Priority: Minor > > With HBASE-23795, the hope is to drive tests with maven and surefire much > closer to their potential. > That will still leave a lot of room for improvement. > For those that have some nice hardware and a need for speed, we can blow > right past maven+surefire. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23806) Provide a much faster and efficient alternate option to maven and surefire for running tests.
[ https://issues.apache.org/jira/browse/HBASE-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081129#comment-17081129 ] Mark Robert Miller commented on HBASE-23806: I look at this as not likely something that will be contributed back, but that will demonstrate the upper bounds of how fast tests can run. Once you are running efficiently in parallel on a lot of cores, it takes a little extra to keep all those cores busy vs having a long tail of less and less cores being utilized. This can have a very large difference, and while you can't always get there with standard test systems, it's good to know how far off you are as well. The order you start the parallel tests in and how you distribute them across jvms on good hardware can easily half the test time or more. > Provide a much faster and efficient alternate option to maven and surefire > for running tests. > - > > Key: HBASE-23806 > URL: https://issues.apache.org/jira/browse/HBASE-23806 > Project: HBase > Issue Type: Wish >Reporter: Mark Robert Miller >Priority: Minor > > With HBASE-23795, the hope is to drive tests with maven and surefire much > closer to their potential. > That will still leave a lot of room for improvement. > For those that have some nice hardware and a need for speed, we can blow > right past maven+surefire. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23806) Provide a much faster and efficient alternate option to maven and surefire for running tests.
[ https://issues.apache.org/jira/browse/HBASE-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081117#comment-17081117 ] Michael Stack commented on HBASE-23806: --- Overlap w/ HBASE-23779? I can write up doc on how you can go faster if you want (w/ notes on your special sauce). > Provide a much faster and efficient alternate option to maven and surefire > for running tests. > - > > Key: HBASE-23806 > URL: https://issues.apache.org/jira/browse/HBASE-23806 > Project: HBase > Issue Type: Wish >Reporter: Mark Robert Miller >Priority: Minor > > With HBASE-23795, the hope is to drive tests with maven and surefire much > closer to their potential. > That will still leave a lot of room for improvement. > For those that have some nice hardware and a need for speed, we can blow > right past maven+surefire. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-23806) Provide a much faster and efficient alternate option to maven and surefire for running tests.
[ https://issues.apache.org/jira/browse/HBASE-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037448#comment-17037448 ] Mark Robert Miller commented on HBASE-23806: While things have been getting better over the years, build and test running tools in general have not gone very far down the road of good efficiency. In my experience, Gradle easily leads the pack, Maven is trying to match with similiar features, but it's a turbo charger on an Eclipse vs a solid Audi at best. But Gradle is mostly living off what it's done for build, which is great, but no real focus on tests. We can do better for special occasions. > Provide a much faster and efficient alternate option to maven and surefire > for running tests. > - > > Key: HBASE-23806 > URL: https://issues.apache.org/jira/browse/HBASE-23806 > Project: HBase > Issue Type: Wish >Reporter: Mark Robert Miller >Priority: Minor > > With HBASE-23795, the hope is to drive tests with maven and surefire much > closer to their potential. > That will still leave a lot of room for improvement. > For those that have some nice hardware and a need for speed, we can blow > right past maven+surefire. -- This message was sent by Atlassian Jira (v8.3.4#803005)
