Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18421#discussion_r128166394
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/CommandUtils.scala
---
@@ -112,4 +112,29 @@ object CommandUtils extends Logging
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18554
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18554
**[Test build #79740 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79740/testReport)**
for PR 18554 at commit
[`9ba0e2b`](https://github.com/apache/spark/commit/9
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18554
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79740/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18468
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79739/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18468
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18468
**[Test build #79739 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79739/testReport)**
for PR 18468 at commit
[`b83dedb`](https://github.com/apache/spark/commit/b
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/18444
Btw, now I'm wondering Python 3 can handle array like `array('L',
[9223372036854775807])`.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as w
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/18444
Yea, it's related to typecode `'L'` in pypy environment.
We might need to handle it as the same as we did for typecode `'c'` or
override `constructLongArrayFromUInt64()`.
---
If your project is
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18656
LGTM for the code change. But I think we better to have a test for this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your projec
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18656
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79738/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18656
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18656
**[Test build #79738 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79738/testReport)**
for PR 18656 at commit
[`1161ffd`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18655
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18655
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79737/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18655
**[Test build #79737 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79737/testReport)**
for PR 18655 at commit
[`b5988f9`](https://github.com/apache/spark/commit/b
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r128162324
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -103,4 +110,19 @@ case class UserDefinedFunction protected
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18444
Sounds actually related:
```
==
ERROR: test_array_types (pyspark.sql.tests.SQLTests)
-
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r128161850
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -103,4 +110,19 @@ case class UserDefinedFunction prot
Github user zasdfgbnm commented on the issue:
https://github.com/apache/spark/pull/18444
Looks to be an unrelated error.
_Sent from my OnePlus ONEPLUS A3000 using
[FastHub](https://play.google.com/store/apps/details?id=com.fastaccess.github)_
---
If your project is set up fo
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18421
Is that possible the partition-level row counts is larger than the
table-level row counts after running this new command?
---
If your project is set up for it, you can reply to this email and ha
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18462
**[Test build #79742 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79742/testReport)**
for PR 18462 at commit
[`9aee54a`](https://github.com/apache/spark/commit/9a
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r128159939
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -103,4 +110,19 @@ case class UserDefinedFunction protected
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r128159874
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -103,4 +110,19 @@ case class UserDefinedFunction protected
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r128159780
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -58,6 +55,13 @@ case class UserDefinedFunction protected[s
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18462
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the fe
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18462
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18462
sorry, I forgot it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18655
**[Test build #79741 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79741/testReport)**
for PR 18655 at commit
[`a50a271`](https://github.com/apache/spark/commit/a5
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18444
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18444
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79736/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18444
**[Test build #79736 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79736/testReport)**
for PR 18444 at commit
[`88091ea`](https://github.com/apache/spark/commit/8
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18554
**[Test build #79740 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79740/testReport)**
for PR 18554 at commit
[`9ba0e2b`](https://github.com/apache/spark/commit/9b
Github user facaiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/18554#discussion_r128158473
--- Diff: python/pyspark/ml/tests.py ---
@@ -1255,6 +1255,17 @@ def test_output_columns(self):
output = model.transform(df)
self.ass
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128156883
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/vectorized/ColumnarBatchSuite.scala
---
@@ -326,6 +329,84 @@ class ColumnarBatchSuite ex
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18503#discussion_r128156305
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamSuite.scala ---
@@ -479,6 +479,61 @@ class StreamSuite extends StreamTest {
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/18444
LGTM, too. pending Jenkins.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wish
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18444
Okay. LGTM.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or i
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128152848
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
---
@@ -0,0 +1,416 @@
+/*
+ * Licensed to the
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128152870
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
---
@@ -0,0 +1,416 @@
+/*
+ * Licensed to the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18468
**[Test build #79739 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79739/testReport)**
for PR 18468 at commit
[`b83dedb`](https://github.com/apache/spark/commit/b8
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18388#discussion_r128151097
--- Diff:
common/network-common/src/main/java/org/apache/spark/network/server/OneForOneStreamManager.java
---
@@ -25,6 +25,9 @@
import com.goo
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18388#discussion_r128151076
--- Diff:
common/network-common/src/main/java/org/apache/spark/network/server/OneForOneStreamManager.java
---
@@ -139,6 +153,32 @@ public void checkAutho
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128149909
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
---
@@ -0,0 +1,416 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18388#discussion_r128149914
--- Diff:
common/network-common/src/main/java/org/apache/spark/network/server/OneForOneStreamManager.java
---
@@ -53,9 +56,13 @@
// that the cal
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18656
LGTM, can you update the PR description?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18656
**[Test build #79738 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79738/testReport)**
for PR 18656 at commit
[`1161ffd`](https://github.com/apache/spark/commit/11
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18656
ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if t
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18655
**[Test build #79737 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79737/testReport)**
for PR 18655 at commit
[`b5988f9`](https://github.com/apache/spark/commit/b5
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18678
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79735/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18678
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18678
**[Test build #79735 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79735/testReport)**
for PR 18678 at commit
[`41d550f`](https://github.com/apache/spark/commit/4
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/18655
I see, I'll move files back to `arrow` package.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18655#discussion_r128146875
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/arrow/ArrowConvertersSuite.scala
---
@@ -391,6 +392,85 @@ class ArrowConvertersSuite extend
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18655#discussion_r128146851
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowConverters.scala
---
@@ -55,145 +51,55 @@ private[sql] class ArrowPayload privat
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18655#discussion_r128146856
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/vectorized/ArrowWriter.scala
---
@@ -0,0 +1,405 @@
+/*
+ * Licensed to the Apache S
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18655#discussion_r128146843
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowConverters.scala
---
@@ -55,145 +51,55 @@ private[sql] class ArrowPayload privat
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/18670
@ConeyLiu the network layer doesn't know how to serialize Throwable, or in
other words, it cannot use JavaSerializer in Spark core.
---
If your project is set up for it, you can reply to this email
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18444
**[Test build #79736 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79736/testReport)**
for PR 18444 at commit
[`88091ea`](https://github.com/apache/spark/commit/88
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18656
@cloud-fan Can you help trigger the jenkins test for this? Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user zasdfgbnm commented on the issue:
https://github.com/apache/spark/pull/18444
@HyukjinKwon Take a look at my newest commit. I think I find a better way
to solve the problem that keeps all the hacking code for `SPARK-21465` in a
single place, making it easier to be removed
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18487#discussion_r128145633
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -321,6 +321,17 @@ package object config {
.intConf
Github user ConeyLiu commented on the issue:
https://github.com/apache/spark/pull/18670
Ok, thanks for the answer. I think we can use `ByteBuffer` to solve the
wire compatibility problem, maybe I'm wrong.
I think we should change this, because we also using `onFaliure` to send
fa
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128144943
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
---
@@ -0,0 +1,416 @@
+/*
+ * Licensed to
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128144719
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
---
@@ -0,0 +1,416 @@
+/*
+ * Licensed to
Github user djvulee commented on a diff in the pull request:
https://github.com/apache/spark/pull/18651#discussion_r128144194
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala
---
@@ -505,32 +508,37 @@ private[yarn] class YarnAllocato
Github user djvulee commented on a diff in the pull request:
https://github.com/apache/spark/pull/18651#discussion_r128143898
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala
---
@@ -82,6 +82,8 @@ private[yarn] class YarnAllocator(
Github user DonnyZone commented on the issue:
https://github.com/apache/spark/pull/18656
Thanks for reviewing, I will add a test later.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user debugger87 commented on the issue:
https://github.com/apache/spark/pull/18649
@gatorsmile Could you please help me review this PR?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18468#discussion_r128143583
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
---
@@ -0,0 +1,416 @@
+/*
+ * Licensed to
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18677
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18668#discussion_r128143343
--- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
---
@@ -404,6 +404,13 @@ private[spark] object HiveUtils extends Logging {
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18677
thanks, merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wi
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18677
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79733/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18677
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18677
**[Test build #79733 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79733/testReport)**
for PR 18677 at commit
[`bc8257c`](https://github.com/apache/spark/commit/b
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18444#discussion_r128142573
--- Diff: python/pyspark/sql/types.py ---
@@ -938,12 +1016,17 @@ def _infer_type(obj):
return MapType(_infer_type(key), _infer_type(value
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18656#discussion_r128142552
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -489,13 +489,13 @@ case class CollapseCodegenStages(conf
Github user zasdfgbnm commented on a diff in the pull request:
https://github.com/apache/spark/pull/18444#discussion_r128142511
--- Diff: python/pyspark/sql/types.py ---
@@ -938,12 +1016,17 @@ def _infer_type(obj):
return MapType(_infer_type(key), _infer_type(va
Github user DonnyZone commented on a diff in the pull request:
https://github.com/apache/spark/pull/18656#discussion_r128142467
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -489,13 +489,13 @@ case class CollapseCodegenStages(c
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18677
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18677
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79732/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18677
**[Test build #79732 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79732/testReport)**
for PR 18677 at commit
[`0834050`](https://github.com/apache/spark/commit/0
Github user DonnyZone commented on a diff in the pull request:
https://github.com/apache/spark/pull/18656#discussion_r128142370
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -489,13 +489,13 @@ case class CollapseCodegenStages(c
Github user yaooqinn commented on the issue:
https://github.com/apache/spark/pull/18668
ping @cloud-fan @gatorsmile
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and w
Github user jinxing64 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18634#discussion_r128142152
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/SQLWindowFunctionSuite.scala
---
@@ -356,6 +356,42 @@ class SQLWindowFunctionSuite exten
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/18649
Sorry I'm not familiar with this part, I cannot give you a valid comment,
you could ask others to help reviewing your patch ð .
---
If your project is set up for it, you can reply to this emai
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18673
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r128141710
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala ---
@@ -104,21 +104,35 @@ class UDFRegistration private[sql] (functionRegistr
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18673
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79731/
Test PASSed.
---
Github user zasdfgbnm commented on a diff in the pull request:
https://github.com/apache/spark/pull/18444#discussion_r128141018
--- Diff: python/pyspark/sql/types.py ---
@@ -938,12 +1016,17 @@ def _infer_type(obj):
return MapType(_infer_type(key), _infer_type(va
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18673
**[Test build #79731 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79731/testReport)**
for PR 18673 at commit
[`b82847e`](https://github.com/apache/spark/commit/b
Github user zasdfgbnm commented on a diff in the pull request:
https://github.com/apache/spark/pull/18444#discussion_r128141384
--- Diff: python/pyspark/sql/types.py ---
@@ -938,12 +1016,17 @@ def _infer_type(obj):
return MapType(_infer_type(key), _infer_type(va
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18444#discussion_r128141295
--- Diff: python/pyspark/sql/types.py ---
@@ -938,12 +1016,17 @@ def _infer_type(obj):
return MapType(_infer_type(key), _infer_type(
Github user debugger87 commented on the issue:
https://github.com/apache/spark/pull/18649
@jerryshao Yes, it's just copied from SQLOperation in Hive. However, those
code lines are the key point that HiveServer2 can return operation log to
client via `TFetchResultsReq` which fetchType
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18677
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the fea
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18654
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18670
+1 to keep wire compatibility. Just for curious, if we can re-design it,
shall we use `RpcFailure` to send exception?
---
If your project is set up for it, you can reply to this email and have yo
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18656
Btw, can you also add a test for this? Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this featu
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18654
LGTM, merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wish
1 - 100 of 446 matches
Mail list logo
