GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/22756
[SPARK-25758][ML] Deprecate computeCost on BisectingKMeans
## What changes were proposed in this pull request?
The PR proposes to deprecate the `computeCost` method on `BisectingKMeans`
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22503
**[Test build #97496 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97496/testReport)**
for PR 22503 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22732
At this point I think you both know more than I do about this, so go ahead.
To the limits of my understanding it sounds reasonable.
---
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22746#discussion_r226011439
--- Diff: docs/sql-reference.md ---
@@ -0,0 +1,641 @@
+---
+layout: global
+title: Reference
+displayTitle: Reference
+---
+
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22746
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22746
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22746
**[Test build #97500 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97500/testReport)**
for PR 22746 at commit
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22746
My pleasure, thanks for reviewing this!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22756
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22756
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20859
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97493/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20859
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user RussellSpitzer commented on a diff in the pull request:
https://github.com/apache/spark/pull/21990#discussion_r225992993
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
---
@@ -1136,4 +1121,27 @@ object SparkSession extends Logging {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21990
**[Test build #97497 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97497/testReport)**
for PR 21990 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22756
cc @holdenk @srowen
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21688
**[Test build #97494 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97494/testReport)**
for PR 21688 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22295
**[Test build #97503 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97503/testReport)**
for PR 22295 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22612
**[Test build #4382 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4382/testReport)**
for PR 22612 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22721
what's the impact to end users? wrong statistics?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21990
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97497/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22756
**[Test build #97501 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97501/testReport)**
for PR 22756 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22727
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user maryannxue commented on the issue:
https://github.com/apache/spark/pull/22732
@srowen What @cloud-fan described is a change introduced in #22259. We can
fix it by keeping each call to `ScalaReflection.schemaFor` in their own `Try`
blocks.
As to `UserDefinedFunction`,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22729
I think it's a legit failure. It touches a Kinesis test, and that has
triggered what I assume is an existing problem in the Kinesis integration. It
looks like it didn't like the fact that we updated
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22288
**[Test build #97499 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97499/testReport)**
for PR 22288 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21688
**[Test build #97505 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97505/testReport)**
for PR 21688 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22756
**[Test build #97495 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97495/testReport)**
for PR 22756 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20999
It seems like Hive can drop partitions directly with a partition
expression:
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r225998426
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +420,65 @@ private[spark] class TaskSchedulerImpl(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22466
**[Test build #4381 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4381/testReport)**
for PR 22466 at commit
Github user devaraj-kavali commented on a diff in the pull request:
https://github.com/apache/spark/pull/22752#discussion_r226014153
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -449,7 +450,7 @@ private[history] class
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22708
@cloud-fan and @vofque .
Can we have this fix in `branch-2.3` and `branch-2.2`, too?
It seems that we need another backport PRs for them.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21990
**[Test build #97497 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97497/testReport)**
for PR 21990 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21990
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97503/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22295
**[Test build #97503 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97503/testReport)**
for PR 22295 at commit
Github user sandeep-katta commented on the issue:
https://github.com/apache/spark/pull/22466
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/22757
@srowen I wasn't aware of the Kinesis SDK. Thanks for patching this, looks
good.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22746
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97500/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22746
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22746
**[Test build #97500 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97500/testReport)**
for PR 22746 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22295
**[Test build #97502 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97502/testReport)**
for PR 22295 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22751
merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22575#discussion_r225992780
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -63,7 +63,9 @@ private[kafka010]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22757
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22757
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22757
**[Test build #97498 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97498/testReport)**
for PR 22757 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22721
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user justinuang commented on the issue:
https://github.com/apache/spark/pull/22503
done!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22725
+1 Looks good, thanks @10110346
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22757
CC @Fokko - unfortunately the build didn't catch this one because it didn't
know enough to trigger Kinesis tests.
---
-
To
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/22757
[SPARK-24601][FOLLOWUP] Update Jackson to 2.9.6 in Kinesis
## What changes were proposed in this pull request?
Also update Kinesis SDK's Jackson to match Spark's
## How was this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22756
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97495/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22756
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22756
**[Test build #97495 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97495/testReport)**
for PR 22756 at commit
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22746#discussion_r226011057
--- Diff: docs/_data/menu-sql.yaml ---
@@ -0,0 +1,79 @@
+- text: Getting Started
+ url: sql-getting-started.html
+ subitems:
+-
Github user devaraj-kavali commented on a diff in the pull request:
https://github.com/apache/spark/pull/22752#discussion_r226014282
--- Diff: core/src/main/scala/org/apache/spark/deploy/history/config.scala
---
@@ -64,4 +64,11 @@ private[spark] object config {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20859
**[Test build #97493 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97493/testReport)**
for PR 20859 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22295
**[Test build #97502 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97502/testReport)**
for PR 22295 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97502/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22617
Retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22617
**[Test build #97504 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97504/testReport)**
for PR 22617 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22727
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22756
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22756
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maryannxue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22732#discussion_r225986215
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatDataWriter.scala
---
@@ -179,7 +179,8 @@ class
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22751
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22575#discussion_r225997731
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -631,6 +631,33 @@ object SQLConf {
.intConf
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22575#discussion_r225998489
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/StreamTableDDLCommandSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the
Github user devaraj-kavali commented on a diff in the pull request:
https://github.com/apache/spark/pull/22752#discussion_r226013841
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -449,7 +450,7 @@ private[history] class
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22756#discussion_r226023867
--- Diff: python/pyspark/ml/clustering.py ---
@@ -335,20 +335,6 @@ def clusterCenters(self):
"""Get the cluster centers, represented as a list
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22756#discussion_r226030159
--- Diff: python/pyspark/ml/clustering.py ---
@@ -335,20 +335,6 @@ def clusterCenters(self):
"""Get the cluster centers, represented as a list
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97494/
Test FAILed.
---
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/22547
@cloud-fan, sorry to look at this so late, I was out on vacation for a
little while. Is this about ready for review?
---
-
To
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22608
**[Test build #97478 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97478/testReport)**
for PR 22608 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22608
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97478/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22608
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22746#discussion_r225789933
--- Diff: docs/sql-getting-started.md ---
@@ -0,0 +1,369 @@
+---
+layout: global
+title: Getting Started
+displayTitle: Getting Started
GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/22753
[SPARK-25754][DOC] Change CDN for MathJax
## What changes were proposed in this pull request?
Currently when we open our doc site:
https://spark.apache.org/docs/latest/index.html ,
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22309#discussion_r226149168
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
---
@@ -632,13 +667,17 @@ object ScalaReflection extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22761
**[Test build #97513 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97513/testReport)**
for PR 22761 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22761
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97513/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22761
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22758#discussion_r226151421
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala ---
@@ -193,6 +193,16 @@ private[hive] class
Github user maryannxue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22732#discussion_r226155153
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala ---
@@ -393,4 +393,30 @@ class UDFSuite extends QueryTest with SharedSQLContext
{
Github user maryannxue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22732#discussion_r226155205
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala ---
@@ -393,4 +393,30 @@ class UDFSuite extends QueryTest with SharedSQLContext
{
Github user maryannxue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22732#discussion_r226156109
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -73,19 +73,21 @@ case class UserDefinedFunction
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22675#discussion_r226163959
--- Diff: docs/ml-datasource.md ---
@@ -0,0 +1,49 @@
+---
+layout: global
+title: Data sources
+displayTitle: Data sources
+---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22263
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/22755
cc @gatorsmile, @HyukjinKwon
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user vinodkc closed the pull request at:
https://github.com/apache/spark/pull/22171
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
1 - 100 of 366 matches
Mail list logo
