viirya commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-999749672
For K8S integration tests, all tests are passed (https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50951/console) except two: 1. `- Test decommissioning with dynamic allocation & shuffle cleanups *** FAILED ***` Failed message: ... did not contain "Remove reason statistics: (gracefully decommissioned: 1, decommision unfinished: 0, driver killed: 0, unexpectedly exited: 0)." The application did not complete, driver log did not contain str Remove reason statistics: (gracefully decommissioned: 1, decommision unfinished: 0, driver killed: 0, unexpectedly exited: 0).. (KubernetesSuite.scala:469) The log actually contains " 21/12/22 11:07:12 INFO ExecutorMonitor: Executor 2 is removed. Remove reason statistics: (gracefully decommissioned: 0, decommision unfinished: 1, driver killed: 0, unexpectedly exited: 0)." So looks like it is due to decommission is unfinished. Seems not related to logging change. 2. `- Run SparkR on simple dataframe.R example *** FAILED ***` The related error output: ``` + exec /usr/bin/tini -s -- /opt/spark/bin/spark-submit --conf spark.driver.bindAddress=172.17.0.3 --deploy-mode client --properties-file /opt/spark/conf/spark.properties --class org.apache.spark.deploy.RRunner local:///opt/spark/examples/src/main/r/dataframe.R Error: package or namespace load failed for ‘SparkR’: package ‘SparkR’ was installed before R 4.0.0: please re-install it Execution halted ``` So looks like related R package is out of data (before R 4.0.0). It should not be related to logging change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
