Github user mallman commented on the issue:
https://github.com/apache/spark/pull/15538
> Yeah I see, but this is getting to be quite hacky **just to turn off log
messages**
This isn't just a few annoying log messages. This is an _avalanche_ of log
messages, each of which contains a deep stack trace.
You can read
https://issues.apache.org/jira/browse/SPARK-17993?focusedCommentId=15645322&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15645322
for another perspective.
I agree this patch is ugly. I don't like writing code like this. I just
don't see a feasible alternative for Spark 2.1. It can be removed as part of a
future Parquet 1.9 upgrade.
I abbreviated the console output when I created SPARK-17993. Running a
`spark-sql` query with 10 results on a table written with Spark 1.5 results in
7,052 lines of console output. (The last 10 are the actual results.)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
