[
https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835074#comment-16835074
]
shane knapp commented on SPARK-26944:
-------------------------------------
hmm, actually... i don't think i will need to do anything. the code is a
little confusing, but this is actually behaving as intended. :)
if all py* unit tests pass, nothing is written to python/unit-tests.log
if a test fails, then that output is written to python/unit-tests.log and
testing stops.
the *actual* output from the python unit tests (failing or successful) is
written to target/unit-tests.log along with EVERY OTHER BIT OF UNIT TEST OUTPUT
FROM THE ENTIRE BUILD (emphasis mine).
this isn't actually that useful, and the target/unit-tests.log file is
gigabytes in size. however, breaking the python-only output out of here will
most likely be difficult as this output is logged through scala (ie:
core/src/main/scala/org/apache/spark/util/ShutdownHookManager.scala).
does this make sense?
> Python unit-tests.log not available in artifacts for a build in Jenkins
> -----------------------------------------------------------------------
>
> Key: SPARK-26944
> URL: https://issues.apache.org/jira/browse/SPARK-26944
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 2.4.0
> Reporter: Alessandro Bellina
> Assignee: shane knapp
> Priority: Minor
> Attachments: Screen Shot 2019-03-05 at 12.08.43 PM.png
>
>
> I had a pr where the python unit tests failed. The tests point at the
> `/home/jenkins/workspace/SparkPullRequestBuilder/python/unit-tests.log` file,
> but I can't get to that from jenkins UI it seems (are all prs writing to the
> same file?).
> {code:java}
> ========================================================================
> Running PySpark tests
> ========================================================================
> Running PySpark tests. Output is in
> /home/jenkins/workspace/SparkPullRequestBuilder/python/unit-tests.log{code}
> For reference, please see this build:
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102518/console
> This Jira is to make it available under the artifacts for each build.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
