GitHub user nicklavers opened a pull request:
https://github.com/apache/spark/pull/16580
[SPARK-19219][SQL] Fix Parquet log output defaults
## What changes were proposed in this pull request?
Changing the default parquet logging levels to reflect the changes made in
PR [#15538](https://github.com/apache/spark/pull/15538), in order to prevent
the flood of log messages by default.
## How was this patch tested?
Default log output when reading from parquet 1.6 files was compared with
and without this change. The change eliminates the extraneous logging and makes
the output readable.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/VideoAmp/spark-public
spark-19219-set_default_parquet_log_level
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16580.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16580
----
commit cb801648e55cd632fb5c70ea567908ee83a41bdd
Author: Nick Lavers <[email protected]>
Date: 2017-01-13T19:30:13Z
fixing default parquet logging behavior
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
