Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/5042#issuecomment-92441217
We can't change this now, but note that the commit message / PR description
here is slightly out of date w.r.t. the actual changes being committed, since
we now use the `spark.sql.parquet.output.committer.class` configuration instead
of `spark.sql.parquet.useDirectParquetOutputCommitter`.
We may want to document this configuration at some point; if we do, I think
the right place is the Parquet Configuration section in the SQL programming
guide:
https://spark.apache.org/docs/latest/sql-programming-guide.html#configuration
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
