[ https://issues.apache.org/jira/browse/SPARK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639671#comment-14639671 ]
Apache Spark commented on SPARK-9284: ------------------------------------- User 'vanzin' has created a pull request for this issue: https://github.com/apache/spark/pull/7629 > Remove tests' dependency on the assembly > ---------------------------------------- > > Key: SPARK-9284 > URL: https://issues.apache.org/jira/browse/SPARK-9284 > Project: Spark > Issue Type: Improvement > Components: Tests > Reporter: Marcelo Vanzin > Priority: Minor > > Some tests - in particular tests that have to spawn child processes - > currently rely on the generated Spark assembly to run properly. > This is sub-optimal for a few reasons: > - Users have to use an unnatural "package everything first, then run tests" > approach > - Sometimes tests are run using old code because the user forgot to rebuild > the assembly > The latter is particularly annoying in {{YarnClusterSuite}}. If you modify > some code outside of the {{yarn/}} module, you have to rebuild the whole > assembly before that test picks it up. > We should make all tests run without the need to have an assembly around, > making sure that they always pick up the latest code compiled by the user. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org