Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19448#discussion_r144344565
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -138,6 +138,11 @@ class ParquetFileFormat
conf.setBoolean(ParquetOutputFormat.ENABLE_JOB_SUMMARY, false)
}
+ require(!conf.getBoolean(ParquetOutputFormat.ENABLE_JOB_SUMMARY, false)
+ || classOf[ParquetOutputCommitter].isAssignableFrom(committerClass),
+ s"Committer $committerClass is not a ParquetOutputCommitter and
cannot create job summaries."
+ + " Set Parquet option " + ParquetOutputFormat.ENABLE_JOB_SUMMARY + "
to false.")
--- End diff --
nit:
```scala
...
s"Committer $committerClass is not a ParquetOutputCommitter and cannot
create job summaries. " +
s"Set Parquet option '${ParquetOutputFormat.ENABLE_JOB_SUMMARY}' to
false.")
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
