Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22572#discussion_r221305617
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala
---
@@ -183,15 +183,16 @@ object FileFormatWriter extends Logging {
val commitMsgs = ret.map(_.commitMsg)
committer.commitJob(job, commitMsgs)
- logInfo(s"Job ${job.getJobID} committed.")
+ logInfo(s"Job ${job.getConfiguration.get("mapreduce.job.id")}
committed.")
--- End diff --
SparkHadoopWriter needs a similar change, then, BTW
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
