Github user srowen commented on the issue:
https://github.com/apache/spark/pull/21488
Ack I missed something here: there's an override of kafka.version for Scala
2.12, from when it had to be bumped _up_ to work with 2.12. That no longer
works when compiling with 2.12. I'll submit a
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21721
Looks fine otherwise to me too if the test passes
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21954
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #93917 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93917/testReport)**
for PR 21941 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21721#discussion_r207090934
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/progress.scala ---
@@ -163,7 +163,27 @@ class SourceProgress protected[sql](
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21608#discussion_r207090891
--- Diff: docs/sql-programming-guide.md ---
@@ -1872,6 +1872,8 @@ working with timestamps in `pandas_udf`s to get the
best performance, see
- In
Github user Achuth17 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21608#discussion_r207090805
--- Diff: docs/sql-programming-guide.md ---
@@ -1872,6 +1872,8 @@ working with timestamps in `pandas_udf`s to get the
best performance, see
- In
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21954
@ueshin, thanks! I am a bot who has found some folks who might be able to
help with the review:@rxin, @cloud-fan and @hvanhovell
---
GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/21954
[SPARK-23908][SQL] Add transform function.
## What changes were proposed in this pull request?
This pr adds `transform` function which transforms elements in an array
using the function.
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21754#discussion_r207090637
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala
---
@@ -89,23 +97,42 @@ case class ReuseExchange(conf: SQLConf)
Github user Achuth17 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21608#discussion_r207090543
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1449,6 +1449,15 @@ object SQLConf {
.intConf
Github user Achuth17 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21608#discussion_r207090467
--- Diff: docs/sql-programming-guide.md ---
@@ -1872,6 +1872,8 @@ working with timestamps in `pandas_udf`s to get the
best performance, see
- In
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93911/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21722
**[Test build #93933 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93933/testReport)**
for PR 21722 at commit
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21754#discussion_r207090221
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala
---
@@ -52,6 +52,14 @@ case class ReusedExchangeExec(override val
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21898
**[Test build #93911 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93911/testReport)**
for PR 21898 at commit
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21919
I like the idea of doing this, but I don't think it really belongs as part
of the WriterCommitMessage interface. Every connector shouldn't have to
independently count its rows; the execution
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21722
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21889
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93932/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21889
**[Test build #93932 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93932/testReport)**
for PR 21889 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21889
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21889
**[Test build #93932 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93932/testReport)**
for PR 21889 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21935#discussion_r207089232
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -36,11 +36,12 @@ import org.apache.spark.sql._
import
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21935#discussion_r207089217
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/SchemaConverters.scala
---
@@ -103,31 +108,49 @@ object SchemaConverters {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21915
**[Test build #93931 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93931/testReport)**
for PR 21915 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21915
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21915
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21199
The change looks broadly good (and important) to me. I'll defer to
@HeartSaVioR wrt the in-depth review; let me know if there are any specific
parts I should to take a look at.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21935#discussion_r207088878
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala ---
@@ -79,4 +80,16 @@ class AvroOptions(
val compression:
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21915
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21699#discussion_r207088444
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala ---
@@ -339,29 +400,30 @@ class RelationalGroupedDataset
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21699#discussion_r207088374
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/DataFramePivotSuite.scala ---
@@ -246,4 +267,77 @@ class DataFramePivotSuite extends QueryTest
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21754
Sorry, but I forgot this pr... I'll do today.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21699
If this PR proposes a different API then an overloaded version of
`pivot(String, Seq[Any])`, it's a different issue though I guess.
I would prefer to have `pivot(Column, Seq[Any])` and
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r207087848
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1349,6 +1339,29 @@ class DAGScheduler(
s"longer
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21933
Can you add `[SPARK-24917][CORE]` in the title? Also, you need to describe
more in the description about this issue; what does this pr solve?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #93930 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93930/testReport)**
for PR 21632 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93930/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/21952
Maybe due to test environment difference, I ran the benchmark code above
but didn't notice significant regression. See if others can confirm the
regression too.
---
Github user imatiach-msft commented on the issue:
https://github.com/apache/spark/pull/16722
@HyukjinKwon yes, I've updated this PR in #21632
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15670
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21752
kindly ping again @c-horn
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #93930 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93930/testReport)**
for PR 21632 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21947
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user 10110346 commented on the issue:
https://github.com/apache/spark/pull/21825
Thanks @srowen
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #93928 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93928/testReport)**
for PR 21632 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93928/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21947
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21947
**[Test build #93929 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93929/testReport)**
for PR 21947 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21947
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21825
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21952
This is serious and we should fix it before Spark 2.4.
For the benchmark, I have 2 questions:
1. will the regression caused by the df cache? we can run
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21947
Let me just push this in. The last change shouldn't really affect anything
..
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21947
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/21825
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #93928 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93928/testReport)**
for PR 21632 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/21947#discussion_r207083969
--- Diff: docs/_config.yml ---
@@ -1,6 +1,6 @@
highlighter: pygments
markdown: kramdown
-gems:
+plugins:
--- End diff --
Ah OK
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21947#discussion_r207083726
--- Diff: docs/_config.yml ---
@@ -1,6 +1,6 @@
highlighter: pygments
markdown: kramdown
-gems:
+plugins:
--- End diff --
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21953
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21953
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21953
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21953
@tgravescs Can you test this please? Thank you.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21892#discussion_r207083344
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala
---
@@ -203,19 +203,11 @@ class UnivocityParser(
GitHub user hthuynh2 opened a pull request:
https://github.com/apache/spark/pull/21953
[SPARK-24992][Core] spark should randomize yarn local dir selection
**Description:
[SPARK-24992](https://issues.apache.org/jira/browse/SPARK-24992)**
Utils.getLocalDir is used to get path of
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21953
@hthuynh2, thanks! I am a bot who has found some folks who might be able to
help with the review:@li-zhihui, @mateiz and @pwendell
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21469
**[Test build #93927 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93927/testReport)**
for PR 21469 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21944#discussion_r207083002
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -1367,6 +1367,22 @@ class Dataset[T] private[sql](
}: _*)
}
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21915
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21305
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21915
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93910/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21305
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93908/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21915
**[Test build #93910 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93910/testReport)**
for PR 21915 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21889
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #93926 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93926/testReport)**
for PR 21632 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21305
**[Test build #93908 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93908/testReport)**
for PR 21305 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93926/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21889
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93925/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21889
**[Test build #93925 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93925/testReport)**
for PR 21889 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #93926 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93926/testReport)**
for PR 21632 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21469
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21889
**[Test build #93925 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93925/testReport)**
for PR 21889 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21950
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93912/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21950
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21950
**[Test build #93912 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93912/testReport)**
for PR 21950 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21952
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93922/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21952
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21952
**[Test build #93922 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93922/testReport)**
for PR 21952 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21945
**[Test build #93924 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93924/testReport)**
for PR 21945 at commit
201 - 300 of 890 matches
Mail list logo
