Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/15369
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/15355
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/15239#discussion_r82367394
--- Diff: R/pkg/R/SQLContext.R ---
@@ -341,11 +342,13 @@ setMethod("toDF", signature(x = "RDD"),
#' @name read.json
#' @method read.json
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15369
merged to master. Seems like a clean improvement.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15307
**[Test build #66495 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66495/consoleFull)**
for PR 15307 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15355
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15307
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15307
**[Test build #66494 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66494/consoleFull)**
for PR 15307 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15307
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66494/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15307
**[Test build #66494 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66494/consoleFull)**
for PR 15307 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15307
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66492/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15307
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15307
**[Test build #66492 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66492/consoleFull)**
for PR 15307 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14638
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66493/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14638
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14638
**[Test build #66493 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66493/consoleFull)**
for PR 14638 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/15239#discussion_r82362700
--- Diff: R/pkg/R/SQLContext.R ---
@@ -341,11 +342,13 @@ setMethod("toDF", signature(x = "RDD"),
#' @name read.json
#' @method read.json
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15371
I see the new copy (of course or else this wouldn't help) but where is a
copy removed? I'm probably overlooking it. A `toList` call was moved, which we
discussed above briefly. I still think it's
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15292
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66491/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15292
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15292
**[Test build #66491 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66491/consoleFull)**
for PR 15292 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14538
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66490/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14538
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14538
**[Test build #66490 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66490/consoleFull)**
for PR 14538 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/15239#discussion_r82355751
--- Diff: R/pkg/R/SQLContext.R ---
@@ -341,11 +342,13 @@ setMethod("toDF", signature(x = "RDD"),
#' @name read.json
#' @method read.json
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15263
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15263
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66489/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15263
**[Test build #66489 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66489/consoleFull)**
for PR 15263 at commit
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/15239#discussion_r82352445
--- Diff: R/pkg/R/SQLContext.R ---
@@ -341,11 +342,13 @@ setMethod("toDF", signature(x = "RDD"),
#' @name read.json
#' @method read.json
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15388
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66488/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15388
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15388
**[Test build #66488 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66488/consoleFull)**
for PR 15388 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15355
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15355
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66487/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15355
**[Test build #66487 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66487/consoleFull)**
for PR 15355 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14638
**[Test build #66493 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66493/consoleFull)**
for PR 14638 at commit
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/15307
@marmbrus
- Refactored APIs (see description)
- Added source-specific tests
- Fixed LocalTableScanExec.executeCollect/executeTake not providing
SQLMetrics
- Reverted *Status classes to
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/15307#discussion_r82348471
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryStatus.scala
---
@@ -0,0 +1,102 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15307
**[Test build #66492 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66492/consoleFull)**
for PR 15307 at commit
Github user seyfe commented on the issue:
https://github.com/apache/spark/pull/15371
Hi @srowen,
This PR doesn't introduce any extra data copy operations. It moves the data
copy code from `JsonProtocol:accumValueToJson` method to
`BlockStatusesAccumulator:value` method so
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/15148#discussion_r82343881
--- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinHash.scala ---
@@ -0,0 +1,107 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/15148#discussion_r82342839
--- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala ---
@@ -0,0 +1,339 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/15148#discussion_r82342444
--- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala ---
@@ -0,0 +1,339 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15370
Yeah, the name should be zero-padded to 10 digits to make the lexical
ordering match the intended ordering. It may not matter, but seems a bit safer.
OK right the code path doesn't just list
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14957
This would be good to include in Spark 2.1...
cc @davies and @liancheng
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user srowen closed the pull request at:
https://github.com/apache/spark/pull/15343
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15343
Hm, I think I'm going to close this for now because it doesn't actually fix
the issue I thought it would, and I honestly could not trace how the cached
Dataset logical plan becomes RDD info in the
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/15148#discussion_r82340840
--- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala ---
@@ -0,0 +1,339 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/15379
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15292
**[Test build #66491 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66491/consoleFull)**
for PR 15292 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/15379
Thanks - the argument renaming issue is largely orthogonal and I don't
think we can break it now. I'm going to merge this in master/2.0.
---
If your project is set up for it, you can reply to this
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15382
Good point. The docs all say it should be working dir, so I was following
the apparent intent along the way here. I don't know if one is more surprising
than the other.
---
If your project is set
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14538
**[Test build #66490 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66490/consoleFull)**
for PR 14538 at commit
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/15381#discussion_r82339491
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java
---
@@ -90,8 +95,21 @@ public void run() {
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/15292#discussion_r82339188
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala
---
@@ -17,47 +17,130 @@
package
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14538
Jenkins retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15263
**[Test build #66489 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66489/consoleFull)**
for PR 15263 at commit
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/15148#discussion_r82337939
--- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala ---
@@ -0,0 +1,339 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15263
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15292
BTW, I finished the review. LGTM except the above comments. Let @cloud-fan
double check it. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/15371#discussion_r82336487
--- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala ---
@@ -281,7 +281,7 @@ private[spark] object JsonProtocol {
("Finish Time" ->
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/15389
cc @davies
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15389
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66486/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15389
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15389
**[Test build #66486 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66486/consoleFull)**
for PR 15389 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15388
**[Test build #66488 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66488/consoleFull)**
for PR 15388 at commit
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/15388#discussion_r82336141
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Canonicalize.scala
---
@@ -62,6 +62,9 @@ object Canonicalize extends {
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/15355
I have re-enables the kafka test. This PR now only contains a change to
build infrastructure.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15355
**[Test build #66487 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66487/consoleFull)**
for PR 15355 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/15351
Thank you so much, @hvanhovell .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user dongjoon-hyun closed the pull request at:
https://github.com/apache/spark/pull/15351
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15354
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15354
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66484/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15389
**[Test build #66486 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66486/consoleFull)**
for PR 15389 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15354
**[Test build #66484 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66484/consoleFull)**
for PR 15354 at commit
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/15239#discussion_r82333423
--- Diff: R/pkg/R/DataFrame.R ---
@@ -841,8 +865,9 @@ setMethod("saveAsParquetFile",
#' @note write.text since 2.0.0
setMethod("write.text",
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/15292#discussion_r82333056
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala
---
@@ -17,47 +17,130 @@
package
601 - 677 of 677 matches
Mail list logo
