shaneknapp commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548496402 > Seems OK to me, though I don't know this script well. this is @holdenk 's contribution... should have added her to the review earlier. also, if you look at the console output (https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112977/console), the following block of code in `dev/run-pip-tests` causes some really ugly `log4j` errors that i would LOVE to clean up (but i'm not entirely sure if that's easy/possible): ``` echo "Run basic sanity check on pip installed version with spark-submit" spark-submit "$FWDIR"/dev/pip-sanity-check.py echo "Run basic sanity check with import based" python "$FWDIR"/dev/pip-sanity-check.py echo "Run the tests for context.py" python "$FWDIR"/python/pyspark/context.py ``` ``` Run basic sanity check on pip installed version with spark-submit log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: target/unit-tests.log (No such file or directory) at java.io.FileOutputStream.open0(Native Method) <SNIP> Successfully ran pip sanity check ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
