Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21705#discussion_r199936887
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
---
@@ -66,6 +66,12 @@ object StaticSQLConf {
.checkV
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21699
**[Test build #92577 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92577/testReport)**
for PR 21699 at commit
[`fae4fd2`](https://github.com/apache/spark/commit/fa
Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r199935864
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/OptionRequirements.scala
---
@@ -0,0 +1,40 @@
+/*
+
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21707
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21707
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92576/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21707
**[Test build #92576 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92576/testReport)**
for PR 21707 at commit
[`cd9bdca`](https://github.com/apache/spark/commit/c
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/21146
I guess leave a note about why the activation artifact is managed there.
Safer to keep it I guess. That artifact will almost surely not change.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21686
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92575/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21686
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21686
**[Test build #92575 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92575/testReport)**
for PR 21686 at commit
[`c993fd1`](https://github.com/apache/spark/commit/c
Github user gsemet commented on the issue:
https://github.com/apache/spark/pull/13599
Hi. I think until we get a core developer really interested in packaging
python dependencies correctly, this PR wonât evolve a lot
---
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21667
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92569/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21667
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21667
**[Test build #92569 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92569/testReport)**
for PR 21667 at commit
[`5c590eb`](https://github.com/apache/spark/commit/5
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/21146
There's usually good reasons for upgrading crypto stuff like bouncy castle;
nothing to feel bad about.
How about I take this patch & add the explicit activation 1.1.1 ref to
reinstate
Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21659#discussion_r199916087
--- Diff: python/docs/Makefile ---
@@ -1,19 +1,44 @@
# Makefile for Sphinx documentation
#
+ifndef SPHINXBUILD
+ifndef SPHINXPYTHON
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/21659
When you say orthogonally do you mean with another PR?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For add
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21707
**[Test build #92576 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92576/testReport)**
for PR 21707 at commit
[`cd9bdca`](https://github.com/apache/spark/commit/cd
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21707
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/646/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21707
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
GitHub user tgravescs opened a pull request:
https://github.com/apache/spark/pull/21707
Update for spark 2.2.2 release
Release process for Spark 2.2.2 say to update the test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tgraves
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21699
> Were you planning to add a new overload for each existing String
version, e.g. pivot(Column) and pivot(Column, java.util.List[Any])?
The methods have been added already. @rednaxelafx Plea
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21699
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21699
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92568/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21699
**[Test build #92568 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92568/testReport)**
for PR 21699 at commit
[`d62b7e7`](https://github.com/apache/spark/commit/d
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21601
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21601
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92566/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21601
**[Test build #92566 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92566/testReport)**
for PR 21601 at commit
[`15356df`](https://github.com/apache/spark/commit/1
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199907218
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, opti
Github user rednaxelafx commented on the issue:
https://github.com/apache/spark/pull/21699
This mostly looks good, but I'd like to ask a few things first:
1. The new overloaded `pivot()` that takes `Column` only exist for
`pivot(Column, Seq[Any])`. Were you planning to add a n
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199902249
--- Diff: python/pyspark/sql/functions.py ---
@@ -2189,11 +2189,16 @@ def from_json(col, schema, options={}):
>>> df = spark.createDataFrame(dat
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21649
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92574/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21649
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21649
**[Test build #92574 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92574/testReport)**
for PR 21649 at commit
[`aec391c`](https://github.com/apache/spark/commit/a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21705
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21705
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92567/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21705
**[Test build #92567 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92567/testReport)**
for PR 21705 at commit
[`4655a2c`](https://github.com/apache/spark/commit/4
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199899927
--- Diff: python/pyspark/sql/functions.py ---
@@ -2189,11 +2189,16 @@ def from_json(col, schema, options={}):
>>> df = spark.createDataFrame(data, (
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199899708
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, options)
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21659
@mengxr, thanks for reporting it. This will probably related with
`functools.wraps`'s behaviour between Python 2 and 3. Python 3 copies its
signature and Python 2 doesn't. Let me make a progress
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21705
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92565/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21705
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21705
**[Test build #92565 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92565/testReport)**
for PR 21705 at commit
[`0a9eaa2`](https://github.com/apache/spark/commit/0
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199894916
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, options)
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21659
@HyukjinKwon I reported the issue to Sphinx at
https://github.com/sphinx-doc/sphinx/issues/5142. We are not sure if Python 2
is the root cause. I don't have strong preferences on the approaches discu
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199891460
--- Diff: python/pyspark/sql/functions.py ---
@@ -2189,11 +2189,16 @@ def from_json(col, schema, options={}):
>>> df = spark.createDataFrame(dat
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199891105
--- Diff: python/pyspark/sql/functions.py ---
@@ -2235,6 +2240,28 @@ def to_json(col, options={}):
return Column(jc)
+@ignore_un
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199890912
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, opti
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199890648
--- Diff: python/pyspark/sql/functions.py ---
@@ -2189,11 +2189,16 @@ def from_json(col, schema, options={}):
>>> df = spark.createDataFrame(dat
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21686
**[Test build #92575 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92575/testReport)**
for PR 21686 at commit
[`c993fd1`](https://github.com/apache/spark/commit/c9
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21693
**[Test build #4204 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4204/testReport)**
for PR 21693 at commit
[`d4ebc8f`](https://github.com/apache/spark/commit/
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21459
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21649
**[Test build #92574 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92574/testReport)**
for PR 21649 at commit
[`aec391c`](https://github.com/apache/spark/commit/ae
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21649
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/645/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21649
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user michaelmior commented on the issue:
https://github.com/apache/spark/pull/21433
@srowen Yes, I don't expect it will be widely used but I've personally
found it helpful in some performance debugging and it's a fairly low impact
change. I was just hoping to avoid having to ke
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21459
Thanks. Merged into master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: re
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21433
**[Test build #4203 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4203/testReport)**
for PR 21433 at commit
[`245181a`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21588
**[Test build #92573 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92573/testReport)**
for PR 21588 at commit
[`b69e29a`](https://github.com/apache/spark/commit/b6
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21588
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/644/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21588
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199883857
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala
---
@@ -744,11 +747,42 @@ case class StructsToJson(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21705
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21705
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92564/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21705
**[Test build #92564 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92564/testReport)**
for PR 21705 at commit
[`8ee8e00`](https://github.com/apache/spark/commit/8
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21686
Seems fine to me otherwise.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mai
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199881408
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, opti
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199881316
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala
---
@@ -744,11 +747,42 @@ case class StructsToJson(
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199881050
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, opti
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199879761
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, opti
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21633
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92563/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21633
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199879469
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -148,6 +144,28 @@ class JsonFileFormat exte
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21633
**[Test build #92563 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92563/testReport)**
for PR 21633 at commit
[`4419f52`](https://github.com/apache/spark/commit/4
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199878616
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, options)
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21686#discussion_r199877744
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3381,6 +3381,48 @@ object functions {
from_json(e, dataType, options)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21542
**[Test build #92572 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92572/testReport)**
for PR 21542 at commit
[`58e8c3c`](https://github.com/apache/spark/commit/58
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21542
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/643/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21542
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21542
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92571/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21542
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21542
**[Test build #92571 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92571/testReport)**
for PR 21542 at commit
[`8ffd23b`](https://github.com/apache/spark/commit/8
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21542
**[Test build #92571 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92571/testReport)**
for PR 21542 at commit
[`8ffd23b`](https://github.com/apache/spark/commit/8f
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21657
Eh .. actually can we revive
https://github.com/apache/spark/commit/64fad0b519cf35b8c0a0dec18dd3df9488a5ed25#diff-d19881aceddcaa5c60620fdcda99b4c4L79
? This sounds safer to me.
---
--
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199867594
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcSourceSuite.scala
---
@@ -156,28 +156,6 @@ class HiveOrcSourceSuite extends OrcS
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199865933
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -148,6 +144,28 @@ class JsonFileFormat
Github user dmateusp commented on the issue:
https://github.com/apache/spark/pull/21706
Just added it to the FunctionRegistry:
```scala
scala> spark.sql("DESC function calendarinterval").show(truncate=false)
+-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21702
**[Test build #92570 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92570/testReport)**
for PR 21702 at commit
[`960769a`](https://github.com/apache/spark/commit/96
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21699
cc @aray
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spa
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21702
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@s
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21667
@HyukjinKwon @maropu I have updated the code. It is now using whitelist.
@cloud-fan Thanks for the review and +1
---
-
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199863675
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcSourceSuite.scala
---
@@ -156,28 +156,6 @@ class HiveOrcSourceSuite extends OrcSui
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199863349
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -148,6 +144,28 @@ class JsonFileFormat exte
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199862160
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -306,6 +306,7 @@ case class FileSourceScanExec(
}
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199861581
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormat.scala
---
@@ -152,6 +152,12 @@ trait FileFormat {
}
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199861251
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala
---
@@ -42,65 +38,9 @@ object DataSourceUtils {
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199860902
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -306,6 +306,7 @@ case class FileSourceScanExec(
}
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21667#discussion_r199860192
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala
---
@@ -42,65 +38,9 @@ object DataSourceUtils {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21667
**[Test build #92569 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92569/testReport)**
for PR 21667 at commit
[`5c590eb`](https://github.com/apache/spark/commit/5c
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21705#discussion_r199858281
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/internal/ExecutorSideSQLConfSuite.scala
---
@@ -40,16 +40,24 @@ class ExecutorSideSQLConfSuite ext
201 - 300 of 435 matches
Mail list logo