[
https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238769#comment-14238769
]
Nicholas Chammas commented on SPARK-3431:
-----------------------------------------
[~nkeywal] - I took a quick look at HBase's {{pom.xml}} based on your comments
in the Spark [dev list
discussion|http://apache-spark-developers-list.1001551.n3.nabble.com/Unit-tests-in-lt-5-minutes-td7757.html]
about speeding up unit tests. It looks a bit complex, but perhaps Spark's pom
file will eventually end up looking similar for tests.
For Spark, I've taken an initial step by just having Maven use Surefire to run
tests ([here's the
patch|https://issues.apache.org/jira/browse/SPARK-3431?focusedCommentId=14238666&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14238666]),
but tests aren't running successfully.
Is there anything off the top of your head that I've obviously missed?
> Parallelize execution of tests
> ------------------------------
>
> Key: SPARK-3431
> URL: https://issues.apache.org/jira/browse/SPARK-3431
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Reporter: Nicholas Chammas
> Assignee: Nicholas Chammas
>
> Running all the tests in {{dev/run-tests}} takes up to 2 hours. A common
> strategy to cut test time down is to parallelize the execution of the tests.
> Doing that may in turn require some prerequisite changes to be made to how
> certain tests run.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
