Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/19269#discussion_r142004814
--- Diff:
sql/core/src/test/java/test/org/apache/spark/sql/sources/v2/JavaSimpleWritableDataSource.java
---
@@ -0,0 +1,297 @@
+/*
+ *
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/19269#discussion_r142004778
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Command.scala
---
@@ -0,0 +1,113 @@
+/*
+
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19269
People may know that I'm busy with some S3 committers which work with
Hadoop MapReduce & Spark, with an import of Ryan's commtter into the Hadoop
codebase. Thisa includes changes to s3a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19401
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19401
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82350/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19401
**[Test build #82350 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82350/testReport)**
for PR 19401 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17702
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82351/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17702
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17702
**[Test build #82351 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82351/testReport)**
for PR 17702 at commit
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/19269#discussion_r142004644
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataSourceV2Writer.java
---
@@ -0,0 +1,71 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19287
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82349/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19287
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19287
**[Test build #82349 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82349/testReport)**
for PR 19287 at commit
Github user jsnowacki commented on the issue:
https://github.com/apache/spark/pull/19370
I've explained it in the ticket
https://issues.apache.org/jira/browse/SPARK-18136.
> I think in a long run it would be better to move to some Python packaging
mechanisms like
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19397
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82346/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19397
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19397
**[Test build #82346 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82346/testReport)**
for PR 19397 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/19229
@gatorsmile `withColumn` is reimplemented now. Please take a look when you
have time. Thanks.
---
-
To unsubscribe, e-mail:
Github user connCN closed the pull request at:
https://github.com/apache/spark/pull/19400
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19229
**[Test build #82347 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82347/testReport)**
for PR 19229 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19372
**[Test build #3939 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3939/testReport)**
for PR 19372 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19401
**[Test build #82352 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82352/testReport)**
for PR 19401 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19229
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19229
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82347/
Test PASSed.
---
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/19401#discussion_r142003100
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -238,8 +238,9 @@ class Dataset[T] private[sql](
private[sql] def
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19389
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82345/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19389
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19389
**[Test build #82345 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82345/testReport)**
for PR 19389 at commit
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/19401#discussion_r142002782
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -238,8 +238,9 @@ class Dataset[T] private[sql](
private[sql] def
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17702
**[Test build #82351 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82351/testReport)**
for PR 17702 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19083
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19083
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82348/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19083
**[Test build #82348 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82348/testReport)**
for PR 19083 at commit
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/19401#discussion_r142002605
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -238,8 +238,9 @@ class Dataset[T] private[sql](
private[sql] def
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19401
**[Test build #82350 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82350/testReport)**
for PR 19401 at commit
GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/19401
[SPARK-22176][SQL] Fix overflow issue in Dataset.show
## What changes were proposed in this pull request?
This pr fixed an overflow issue below in `Dataset.show`:
```
scala> Seq((1, 2),
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19400
@connCN close this
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19372
**[Test build #3939 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3939/testReport)**
for PR 19372 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19372
What do you think @LowikC ?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/19340#discussion_r142001964
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala ---
@@ -246,14 +271,16 @@ class KMeans private (
val
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/19340#discussion_r142001976
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala ---
@@ -546,10 +574,88 @@ object KMeans {
.run(data)
}
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/19340#discussion_r142001986
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala ---
@@ -546,10 +574,88 @@ object KMeans {
.run(data)
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19287
**[Test build #82349 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82349/testReport)**
for PR 19287 at commit
Github user devaraj-kavali commented on the issue:
https://github.com/apache/spark/pull/19396
Thanks @jerryshao for the comment.
> IMO I think it might be better to throw an exception instead of not
starting shuffle service. Since user want to use external shuffle explicitly,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19083
**[Test build #82348 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82348/testReport)**
for PR 19083 at commit
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/19083#discussion_r142000625
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -1074,13 +1078,30 @@ object
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19400
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user connCN opened a pull request:
https://github.com/apache/spark/pull/19400
How to use REST api to end sparksql job Or use other way ?
In the REST API doc, I can't find the API for kill a job.Sometimes i
want to kill a dead or slow sparksql job.
You can merge this
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19229
**[Test build #82347 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82347/testReport)**
for PR 19229 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19397
**[Test build #82346 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82346/testReport)**
for PR 19397 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19397
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/19229
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19389
> why the tests are all going into `ParquetPartitionDiscoverySuite` -- this
doesn't seem specific to parquet, and in fact I wonder if it will be different
in parquet since the non-partition
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19389
**[Test build #82345 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82345/testReport)**
for PR 19389 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19229
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82344/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19229
**[Test build #82344 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82344/testReport)**
for PR 19229 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19229
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19389#discussion_r14268
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala
---
@@ -1067,4 +1098,24 @@
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19229
**[Test build #82344 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82344/testReport)**
for PR 19229 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/19393
LGTM but I wrote most of the code so perhaps we should find somebody else
to review.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19287
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19389#discussion_r141999696
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala
---
@@ -149,7 +149,7 @@ object TypeCoercion {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19287
**[Test build #82343 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82343/testReport)**
for PR 19287 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19287
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82343/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19287
**[Test build #82343 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82343/testReport)**
for PR 19287 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19389#discussion_r141999620
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala
---
@@ -249,6 +249,11 @@
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/19229#discussion_r141999421
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -2102,6 +2102,55 @@ class Dataset[T] private[sql](
}
/**
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/18732
Is this just a mapGroups function?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19327
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82342/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19327
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19327
**[Test build #82342 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82342/testReport)**
for PR 19327 at commit
101 - 171 of 171 matches
Mail list logo
