Github user viirya commented on the issue:
https://github.com/apache/spark/pull/20666
cc @cloud-fan @HyukjinKwon To keep CSV reader behavior for corrupted
records, we don't bother to refactoring. But we should update the document and
explicitly disable partial results for corrupted re
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20666
**[Test build #87641 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87641/testReport)**
for PR 20666 at commit
[`4ad330b`](https://github.com/apache/spark/commit/4a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20666
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20666
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1026/
Tes
GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/20666
[SPARK-23448][SQL] Clarify JSON and CSV parser behavior in document
## What changes were proposed in this pull request?
Clarify JSON and CSV reader behavior in document.
JSON doesn'
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87639/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20604
**[Test build #87639 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87639/testReport)**
for PR 20604 at commit
[`35314cb`](https://github.com/apache/spark/commit/3
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20647
> This changes equality for the scan and streaming relation, though.
If we think this is the right equality for `DataSourceV2Relation`, it
should also be the right equality for scan and s
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20647
**[Test build #87640 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87640/testReport)**
for PR 20647 at commit
[`a73370a`](https://github.com/apache/spark/commit/a7
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1025/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170410905
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala ---
@@ -541,7 +541,7 @@ object DecisionTreeSuite extends SparkFunSuite {
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170412046
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -631,6 +651,160 @@ class RandomForestSuite extends SparkFunSuite
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170410747
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -402,20 +405,40 @@ class RandomForestSuite extends SparkFunSuite
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170410687
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -402,20 +407,35 @@ class RandomForestSuite extends SparkFunSuite
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170410775
--- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/Node.scala ---
@@ -283,10 +292,12 @@ private[tree] class LearningNode(
// Here we want to
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170412098
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -631,6 +651,160 @@ class RandomForestSuite extends SparkFunSuite
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170410851
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/tree/impl/RandomForestSuite.scala ---
@@ -18,17 +18,20 @@
package org.apache.spark.ml.tree.impl
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/20632#discussion_r170410834
--- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/Node.scala ---
@@ -270,11 +269,21 @@ private[tree] class LearningNode(
* Convert this [[Learni
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20648
I think at least we should update the document for this behavior of csv
reader.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user sujith71955 commented on the issue:
https://github.com/apache/spark/pull/20611
@gatorsmile Seems to be a random failures, each time random set of test
cases are failing. Please let me know for any suggestions
---
-
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20648
_To me_ I have been roughly thinking that we should better match it to R's
read.csv and explicitly document this. I believe this is a good reference our
CSV has resembled so far.
BTW, I
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87638/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19222
**[Test build #87638 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87638/testReport)**
for PR 19222 at commit
[`95fbdee`](https://github.com/apache/spark/commit/9
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/20648
> Yup, +1 for starting this by disallowing but up to my knowledge R's
read.csv allows then the legnth of tokens are shorter then its schema, putting
nulls (or NA) into missing fields, as a valid cas
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87637/
Test PASSed.
---
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20663#discussion_r170407811
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllStagesPage.scala
---
@@ -19,46 +19,22 @@ package org.apache.spark.ui.jobs
import javax.s
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20663#discussion_r170407883
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllStagesPage.scala
---
@@ -143,76 +72,105 @@ private[ui] class AllStagesPage(parent: StagesTab)
exte
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20663#discussion_r170407867
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllStagesPage.scala
---
@@ -143,76 +72,105 @@ private[ui] class AllStagesPage(parent: StagesTab)
exte
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20663#discussion_r170407936
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllStagesPage.scala
---
@@ -143,76 +72,105 @@ private[ui] class AllStagesPage(parent: StagesTab)
exte
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20663#discussion_r170408040
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllStagesPage.scala
---
@@ -143,76 +72,105 @@ private[ui] class AllStagesPage(parent: StagesTab)
exte
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87637 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87637/testReport)**
for PR 20622 at commit
[`d3b16c1`](https://github.com/apache/spark/commit/d
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87636/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87636 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87636/testReport)**
for PR 20622 at commit
[`d404baf`](https://github.com/apache/spark/commit/d
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20647
Thanks for removing the equality methods. This changes equality for the
scan and streaming relation, though. Are those significant changes?
I still think this should not be committed until th
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20662
Merging to 2.3. Please close the PR manually.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional co
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1024/
Tes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20604
**[Test build #87639 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87639/testReport)**
for PR 20604 at commit
[`35314cb`](https://github.com/apache/spark/commit/35
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20604
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h..
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87635/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20604
**[Test build #87635 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87635/testReport)**
for PR 20604 at commit
[`35314cb`](https://github.com/apache/spark/commit/3
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20653
LGTM
Thanks! Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19222
**[Test build #87638 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87638/testReport)**
for PR 19222 at commit
[`95fbdee`](https://github.com/apache/spark/commit/95
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1023/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/20622
LGTM, assuming tests pass.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: revie
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87637 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87637/testReport)**
for PR 20622 at commit
[`d3b16c1`](https://github.com/apache/spark/commit/d3
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87636 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87636/testReport)**
for PR 20622 at commit
[`d404baf`](https://github.com/apache/spark/commit/d4
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/20622#discussion_r170392408
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousExecution.scala
---
@@ -266,6 +264,12 @@ class ContinuousExecu
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/20648
@HyukjinKwon @cloud-fan Thanks for the comment! Yes, I agreed we need to
keep the CSV's behavior. I will check how much we can clean up with it.
---
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/20622#discussion_r170389827
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousExecution.scala
---
@@ -266,6 +264,12 @@ class ContinuousExecu
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20604
**[Test build #87635 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87635/testReport)**
for PR 20604 at commit
[`35314cb`](https://github.com/apache/spark/commit/35
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1022/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20604
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r170383918
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ---
@@ -55,18 +55,18 @@ private[spark] trait ExecutorAllocationClient {
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20650
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87634/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20647
**[Test build #87634 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87634/testReport)**
for PR 20647 at commit
[`fc29f8f`](https://github.com/apache/spark/commit/f
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20650
lgtm
On Thu, Feb 22, 2018 at 3:38 PM Jose Torres
wrote:
> LGTM
>
> â
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87633/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19222
**[Test build #87633 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87633/testReport)**
for PR 19222 at commit
[`5e3afd1`](https://github.com/apache/spark/commit/5
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20664
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87632/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20664
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20664
**[Test build #87632 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87632/testReport)**
for PR 20664 at commit
[`6d67dfc`](https://github.com/apache/spark/commit/6
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20665
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20665
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user pgillet opened a pull request:
https://github.com/apache/spark/pull/20665
[SPARK-23499][MESOS] Support for priority queues in Mesos scheduler
As for Yarn, Mesos users should be able to specify priority queues to
define a workload management policy for queued drivers in t
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20663
@vanzin sure, thanks. I am creating a new JIRA. Thank you.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Fo
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20663
Could you file a separate bug for this cleanup? Thx
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additio
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170318693
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/memory/ByteArrayMemoryBlock.java
---
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache S
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20663
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87631/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20663
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20663
**[Test build #87631 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87631/testReport)**
for PR 20663 at commit
[`d246df2`](https://github.com/apache/spark/commit/d
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20647
**[Test build #87634 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87634/testReport)**
for PR 20647 at commit
[`fc29f8f`](https://github.com/apache/spark/commit/fc
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1021/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20647
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170311026
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
---
@@ -23,11 +23,11 @@ import org.apache.spark.s
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170307903
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
---
@@ -23,11 +23,11 @@ import org.apache.spar
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170307194
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala
---
@@ -35,15 +35,14 @@ case class DataSourceV2Re
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/20553
`spark.kubernetes.executor.cores` has nothing to do with dynamic resource
allocation. It's just a way of letting users specify a value for the cpu
resource request that conforms to Kubernetes con
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170305944
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/memory/ByteArrayMemoryBlock.java
---
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apac
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170303937
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala
---
@@ -107,17 +106,24 @@ case class DataSourceV2
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170303699
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -77,31 +79,32 @@ class MicroBatchExecution(
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/20647#discussion_r170302233
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
---
@@ -23,11 +23,11 @@ import org.apache.spark.s
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170300286
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java ---
@@ -69,8 +64,9 @@ public long size() {
* Fill this all with
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19222
**[Test build #87633 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87633/testReport)**
for PR 19222 at commit
[`5e3afd1`](https://github.com/apache/spark/commit/5e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1020/
Tes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19222
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170296403
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/memory/MemoryBlock.java ---
@@ -22,10 +22,9 @@
import org.apache.spark.unsafe.Platform;
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170296478
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/memory/MemoryBlock.java ---
@@ -45,38 +44,149 @@
*/
public static final int FREED
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170296358
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/memory/HeapMemoryAllocator.java
---
@@ -58,7 +58,8 @@ public MemoryBlock allocate(long size) th
Github user ala commented on the issue:
https://github.com/apache/spark/pull/20664
Thanks for the comments.
I don't think the users should be impacted by changing execution time. If
the parameters of the job are constant, then the partition allocation should
also be determini
1 - 100 of 174 matches
Mail list logo