Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21618
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21618
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216147915
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -656,6 +656,25 @@ object SQLConf {
.intConf
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216147921
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -724,4 +726,37 @@ object DataSource extends
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216147919
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -724,4 +726,37 @@ object DataSource extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21618
**[Test build #95843 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95843/testReport)**
for PR 21618 at commit
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216147889
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -724,4 +726,37 @@ object DataSource extends
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216147887
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1557,6 +1576,15 @@ class SQLConf extends Serializable with
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/22369#discussion_r216147674
--- Diff: docs/sql-programming-guide.md ---
@@ -1901,6 +1901,7 @@ working with timestamps in `pandas_udf`s to get the
best performance, see
##
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22298
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/22298
Merged to master (e.g. 3). It's not a bug fix but I _think_ we should
consider this for backport to 2.4 since it's arguably the second half of a
feature that's in 2.4, but it's doesn't backport
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/22140
@gatorsmile it seemed like a straightforward bug to me. Rows with extra
values lead to incorrect output and exceptions when used in `DataFrames`, so it
did not seem like there was any possible
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22370
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22370
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22370
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user MichaelChirico opened a pull request:
https://github.com/apache/spark/pull/22370
don't link to deprecated function
Seems misleading to (without qualification) link to a deprecated function
## What changes were proposed in this pull request?
(Please fill
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22369
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95842/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22369
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22369
**[Test build #95842 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95842/testReport)**
for PR 22369 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22369
**[Test build #95842 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95842/testReport)**
for PR 22369 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22368
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22369
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22369
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22368
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22140
```
@xuanyuanking Could you please update the document?
```
#22369 Thanks for reminding, I'll pay attention in future work.
---
GitHub user xuanyuanking opened a pull request:
https://github.com/apache/spark/pull/22369
[SPARK-25072][DOC] Update migration guide for behavior change
## What changes were proposed in this pull request?
Update the document for the behavior change in PySpark Row creation.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22368
**[Test build #95841 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95841/testReport)**
for PR 22368 at commit
GitHub user wangyum opened a pull request:
https://github.com/apache/spark/pull/22368
[SPARK-25368][SQL] Incorrect predicate pushdown returns wrong result
## What changes were proposed in this pull request?
How to reproduce:
```scala
val df1 = spark.createDataFrame(Seq(
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/22010
Actually @holdenk is this change even correct? RDD.distinct is not key
based. It is based on the value of the elements in RDD. Even if `numPartitions
== partitions.length`, it doesn't mean the RDD is
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22010#discussion_r216145892
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -396,7 +396,26 @@ abstract class RDD[T: ClassTag](
* Return a new RDD containing
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22366
Is it better to add a description to `docs/sql-programming-guide.md`?
---
-
To unsubscribe, e-mail:
Github user WeichenXu123 commented on the issue:
https://github.com/apache/spark/pull/22360
Do we need to set `distanceMeasure` again for the parent model ?
When parent model created, it will use the same `distanceMeasure` with the
one used in training.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22367
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95840/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22367
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22367
**[Test build #95840 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95840/testReport)**
for PR 22367 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22357
Thanks! @mallman
For the first query, I think the query plan produced by your WIP patch is
not correct. We don't need to read the `company:struct` from `employer:struct`.
For the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95839/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22366
**[Test build #95839 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95839/testReport)**
for PR 22366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22367
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22367
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22234
@gatorsmile @HyukjinKwon Please, take a look at #22367
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22367
**[Test build #95840 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95840/testReport)**
for PR 22367 at commit
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/22367
[SPARK-17916][SPARK-25241][SQL][FOLLOWUP] Fix empty string being parsed as
null when nullValue is set.
## What changes were proposed in this pull request?
In the PR, I propose new CSV
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22353
@LantaoJin . Please check the following example in Spark UI; the hover text
on `Scan parquet`.
```scala
scala>
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22363
Thank you, @gatorsmile !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95836/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22365
**[Test build #95836 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95836/testReport)**
for PR 22365 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95833/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22337
**[Test build #95833 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95833/testReport)**
for PR 22337 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22366
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22366
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22366
**[Test build #95839 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95839/testReport)**
for PR 22366 at commit
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/22366
[SPARK-25384][SQL] Removing of spark.sql.fromJsonForceNullableSchema
## What changes were proposed in this pull request?
In the PR, I propose to remove the
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22360
Yes, I think the point here is that the parameter is part of
`BisectingKMeansParams` which defines as final the getter method. I think
`KMeans` has the same issue. We can probably remove this and
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22364
cc @gatorsmile @maropu
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21273#discussion_r216138533
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala
---
@@ -164,7 +164,7 @@ class CSVOptions(
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22234
@MaxGekk Could you take this PR over? I think we need to merge this to
Spark 2.4. Users can set the behaviors to the previous one by this new conf
`emptyValue`, if needed. Also update the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95832/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22337
**[Test build #95832 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95832/testReport)**
for PR 22337 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22140
@BryanCutler What is the reason to backport this PR? This sounds a behavior
change.
@xuanyuanking Could you please update the document?
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/17899
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95838/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19045
**[Test build #95838 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95838/testReport)**
for PR 19045 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95837/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19045
**[Test build #95837 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95837/testReport)**
for PR 19045 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19045
**[Test build #95838 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95838/testReport)**
for PR 19045 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/19045
cc @ifilonenko it's super WIP but since you joined me on the stream where I
was working on reviving this I thought it would be good to get your early
comments (especially if you have any
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19045
**[Test build #95837 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95837/testReport)**
for PR 19045 at commit
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/22010
Hey @rxin & @cloud-fan I'd really appreciate your input on the tricks I did
to keep the partioniner information present -- is this the right approach?
---
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/21654
cc @rgbkrk
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22363
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22365
**[Test build #95836 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95836/testReport)**
for PR 22365 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22365
**[Test build #95835 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95835/testReport)**
for PR 22365 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95835/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22365
**[Test build #95835 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95835/testReport)**
for PR 22365 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95834/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22365
**[Test build #95834 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95834/testReport)**
for PR 22365 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22365
**[Test build #95834 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95834/testReport)**
for PR 22365 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22365
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/22365
[SPARK-25381][SQL] Stratified sampling by Column argument
## What changes were proposed in this pull request?
In the PR, I propose to add an overloaded method for `sampleBy` which
accepts
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22349
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/22349
LGTM. Merged into master and branch-2.4. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22353#discussion_r216134032
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -54,7 +54,7 @@ trait DataSourceScanExec extends
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/21618
@kiszk @maropu Great thanks for your review and advise! I'll address them
and resolve the conflicts ASAP.
---
-
To
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216133261
--- Diff:
core/src/test/scala/org/apache/spark/deploy/SparkHadoopUtilSuite.scala ---
@@ -77,6 +80,51 @@ class SparkHadoopUtilSuite extends
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22359
Since this is related to Parquet behavior only, can we have `in Parquet` at
the end of title specifically?
---
-
To
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22363
cc @cloud-fan and @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
1 - 100 of 230 matches
Mail list logo
