Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/13526#discussion_r69986596
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
---
@@ -312,6 +312,17 @@ class DatasetSuite extends QueryTest with
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/13526#discussion_r69986532
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ---
@@ -65,6 +65,46 @@ class KeyValueGroupedDataset[K, V]
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/13526#discussion_r69986479
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ---
@@ -65,6 +65,46 @@ class KeyValueGroupedDataset[K, V]
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/13526#discussion_r69986420
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ---
@@ -65,6 +65,46 @@ class KeyValueGroupedDataset[K, V]
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/13526#discussion_r69986245
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ---
@@ -65,6 +65,46 @@ class KeyValueGroupedDataset[K, V]
Github user marmbrus commented on the issue:
https://github.com/apache/spark/pull/14094
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user marmbrus commented on a diff in the pull request:
https://github.com/apache/spark/pull/14094#discussion_r69986165
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala
---
@@ -45,6 +47,7 @@ class FileStreamSource(
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/13526#discussion_r69986179
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/object.scala
---
@@ -175,6 +175,17 @@ object AppendColumns {
Github user marmbrus commented on a diff in the pull request:
https://github.com/apache/spark/pull/14094#discussion_r69985831
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala
---
@@ -26,6 +27,7 @@ import
Github user husseinhazimeh closed the pull request at:
https://github.com/apache/spark/pull/13980
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14095
**[Test build #61929 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61929/consoleFull)**
for PR 14095 at commit
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69985379
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala
---
@@ -331,6 +331,24 @@ class FileStreamSourceSuite
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69985100
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -281,6 +281,31 @@ final class DataStreamReader
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69985212
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -281,6 +281,31 @@ final class DataStreamReader
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69985195
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -281,6 +281,31 @@ final class DataStreamReader
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69984805
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -281,6 +281,31 @@ final class DataStreamReader
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69984678
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -281,6 +281,31 @@ final class DataStreamReader
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/14095
[SPARK-16429][SQL] Include `StringType` columns in Scala/Python `describe()`
## What changes were proposed in this pull request?
Currently, Spark `describe` supports `StringType`.
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14083#discussion_r69984539
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala
---
@@ -165,111 +169,99 @@ abstract class
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14087#discussion_r69984584
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -281,6 +281,31 @@ final class DataStreamReader
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14094
**[Test build #61928 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61928/consoleFull)**
for PR 14094 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14083
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61923/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14083
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14083
**[Test build #61923 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61923/consoleFull)**
for PR 14083 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14094
**[Test build #61927 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61927/consoleFull)**
for PR 14094 at commit
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/14094
@marmbrus @zsxwing
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/14094
[SPARK-16430][SQL][STREAMING] Add option maxFilesPerTrigger
## What changes were proposed in this pull request?
An option that limits the file stream source to read 1 file at a time
enables
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14083#discussion_r69982767
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala
---
@@ -165,111 +169,99 @@ abstract class
Github user jaceklaskowski commented on a diff in the pull request:
https://github.com/apache/spark/pull/14080#discussion_r69981791
--- Diff:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java
---
@@ -143,4 +179,26 @@ private
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14093
**[Test build #61926 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61926/consoleFull)**
for PR 14093 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14088
**[Test build #61925 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61925/consoleFull)**
for PR 14088 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14088
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14088
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61925/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14088
**[Test build #61925 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61925/consoleFull)**
for PR 14088 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/14088
ok to test. shouldn't be hard to add a unit test.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/13876
Thank you for review and merging, @cloud-fan and @rxin .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14092
**[Test build #3169 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3169/consoleFull)**
for PR 14092 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14092
**[Test build #3168 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3168/consoleFull)**
for PR 14092 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14022
**[Test build #61924 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61924/consoleFull)**
for PR 14022 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14004
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61920/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14004
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14004
**[Test build #61920 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61920/consoleFull)**
for PR 14004 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/14022
> Spark SQL allows env:xxx and system:xxx. We should follow the same here.
Sounds good. I looked briefly at the code and they could potentially be
merged later, but to avoid issues like "how
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11956
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11956
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61919/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11956
**[Test build #61919 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61919/consoleFull)**
for PR 11956 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14083
**[Test build #61923 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61923/consoleFull)**
for PR 14083 at commit
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14092
Ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14081
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61922/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14081
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14081
**[Test build #61922 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61922/consoleFull)**
for PR 14081 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13765#discussion_r69963613
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala ---
@@ -370,8 +370,11 @@ package object dsl {
case
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13894
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61921/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13894
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13894
**[Test build #61921 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61921/consoleFull)**
for PR 13894 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14081
**[Test build #61922 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61922/consoleFull)**
for PR 14081 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13680
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61917/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13680
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13680
**[Test build #61917 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61917/consoleFull)**
for PR 13680 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14093
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14093
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61916/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14093
**[Test build #61916 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61916/consoleFull)**
for PR 14093 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14089
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14089
Thanks - merging in master/2.0.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/14090#discussion_r69955401
--- Diff: docs/sparkr.md ---
@@ -306,6 +306,64 @@ head(ldf, 3)
{% endhighlight %}
+ Run a given function on a large dataset
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/13765
There are three possibilities.
1. User mistakes. (Rarely)
2. Intermediate results of optimization. (More frequently.)
3. `View` (or pre-designed `Dataset`).
---
If your
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13894
**[Test build #61921 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61921/consoleFull)**
for PR 13894 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14030
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13765#discussion_r69951981
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala ---
@@ -370,8 +370,11 @@ package object dsl {
case
Github user krishnakalyan3 commented on the issue:
https://github.com/apache/spark/pull/13894
@holdenk @MLnick sorry for so many changes. Newbie here. Please let me know
if the current state is okay?.
---
If your project is set up for it, you can reply to this email and have your
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14051
@zsxwing crumbs, thanks for that. It looks reasonably sure it's related,
though, I still can't quite figure out how it would cause this failure:
```
[error]
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/14030
LGTM. Merging to master and 2.0.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13765#discussion_r69951435
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala ---
@@ -370,8 +370,11 @@ package object dsl {
case
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/14051
This one broke branch 1.6. I just reverted it. Please resubmit a backport
for branch 1.6.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14004
**[Test build #61920 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61920/consoleFull)**
for PR 14004 at commit
Github user JustinPihony commented on the issue:
https://github.com/apache/spark/pull/14077
@gatorsmile As I said above, I actually think it might be better to keep
the work that was already done and am waiting for Reynold's feedback.
---
If your project is set up for it, you can
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69948642
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala
---
@@ -198,6 +203,67 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14071
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14071
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61914/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14071
**[Test build #61914 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61914/consoleFull)**
for PR 14071 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14081
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14081
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61918/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14081
**[Test build #61918 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61918/consoleFull)**
for PR 14081 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11956
**[Test build #61919 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61919/consoleFull)**
for PR 11956 at commit
Github user shivaram commented on a diff in the pull request:
https://github.com/apache/spark/pull/13984#discussion_r69945470
--- Diff: R/pkg/R/SQLContext.R ---
@@ -744,6 +747,9 @@ read.df.default <- function(path = NULL, source = NULL,
schema = NULL, ...) {
if
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/14012
cc @liancheng please review this PR, thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/14081#discussion_r69944850
--- Diff:
examples/src/main/java/org/apache/spark/examples/ml/JavaPipelineExample.java ---
@@ -1,88 +0,0 @@
-/*
- * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14081
**[Test build #61918 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61918/consoleFull)**
for PR 14081 at commit
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14093#discussion_r69943578
--- Diff:
core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java ---
@@ -349,12 +349,19 @@ void forceSorterToSpill() throws IOException {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13680
**[Test build #61917 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61917/consoleFull)**
for PR 13680 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69943328
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala
---
@@ -198,6 +203,67 @@ case class
Github user lovexi commented on the issue:
https://github.com/apache/spark/pull/14080
@rxin Sure. Get a cleaner title instead.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/14093#discussion_r69943044
--- Diff:
core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java ---
@@ -349,12 +349,19 @@ void forceSorterToSpill() throws IOException {
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69942945
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala
---
@@ -198,6 +203,66 @@ case class
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14093#discussion_r69942754
--- Diff:
core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java ---
@@ -349,12 +349,19 @@ void forceSorterToSpill() throws IOException {
GitHub user rdblue opened a pull request:
https://github.com/apache/spark/pull/14093
SPARK-16420: Ensure compression streams are closed.
## What changes were proposed in this pull request?
This uses the try/finally pattern to ensure streams are closed after use.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14093
**[Test build #61916 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61916/consoleFull)**
for PR 14093 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11956
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11956
**[Test build #61915 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61915/consoleFull)**
for PR 11956 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11956
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61915/
Test FAILed.
---
301 - 400 of 591 matches
Mail list logo
