Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21873#discussion_r205358781
--- Diff: scalastyle-config.xml ---
@@ -150,6 +150,19 @@ This file is divided into 3 sections:
// scalastyle:on println]]></customMessage>
</check>
+ <check customId="hadoopconfiguration" level="error"
class="org.scalastyle.file.RegexChecker" enabled="true">
+ <parameters><parameter
name="regex">spark(.sqlContext)?.sparkContext.hadoopConfiguration</parameter></parameters>
--- End diff --
I think that would be tricky:
1. In core module the function `spark.sessionState.newHadoopConf()` can't
be used.
2. Run `find . -name *.scala|xargs grep hadoopConfiguration |wc -l` and
there are 100 appearances.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
