[
https://issues.apache.org/jira/browse/HBASE-11806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107443#comment-14107443
]
Alex Newman commented on HBASE-11806:
-------------------------------------
So I can tell you that small tests are around 22 minutes to run on circleci
Some ones which take more than 20 seconds (15s is probably a bit short)
Running org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine
Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.727 sec -
in org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine
Running org.apache.hadoop.hbase.thrift2.TestHTablePool$TestHTableReusablePool
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.688 sec - in
org.apache.hadoop.hbase.thrift2.TestHTablePool$TestHTableReusablePool
Running org.apache.hadoop.hbase.thrift.TestThriftServer
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.913 sec - in
org.apache.hadoop.hbase.thrift.TestThriftServer
> Reasses test categories
> -----------------------
>
> Key: HBASE-11806
> URL: https://issues.apache.org/jira/browse/HBASE-11806
> Project: HBase
> Issue Type: Bug
> Reporter: Alex Newman
>
> HBase has an impressive set of tests. It remains a great investment and we
> have done a lot to make them comprehensive. However I feel like we could use
> some improvements on test categorization.
> From http://hbase.apache.org/book/hbase.tests.html
> "18.8.2.1. Small Tests
> Small tests are executed in a shared JVM. We put in this category all the
> tests that can be executed quickly in a shared JVM. The maximum execution
> time for a small test is 15 seconds, and small tests should not use a
> (mini)cluster.
> 18.8.2.2. Medium Tests
> Medium tests represent tests that must be executed before proposing a patch.
> They are designed to run in less than 30 minutes altogether, and are quite
> stable in their results. They are designed to last less than 50 seconds
> individually. They can use a cluster, and each of them is executed in a
> separate JVM.
> 18.8.2.3. Large Tests
> Large tests are everything else. They are typically large-scale tests,
> regression tests for specific bugs, timeout tests, performance tests. They
> are executed before a commit on the pre-integration machines. They can be run
> on the developer machine as well."
--
This message was sent by Atlassian JIRA
(v6.2#6252)
