Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22209#discussion_r212704521
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala ---
@@ -1190,6 +1190,65 @@ class AppStatusListenerSuite extends
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/21665
@uzmijnlm I can take this over and add additional changes, if you're busy.
Is that OK?
---
-
To unsubscribe, e-mail:
Github user Dooyoung-Hwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22219#discussion_r212704387
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala ---
@@ -348,30 +350,30 @@ abstract class SparkPlan extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95219 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95219/testReport)**
for PR 22112 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r212701804
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -1865,6 +1871,57 @@ abstract class RDD[T: ClassTag](
// RDD chain.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r212701416
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -114,6 +114,10 @@ package object config {
.checkValue(_ >= 0,
Github user mallman commented on the issue:
https://github.com/apache/spark/pull/21320
Thanks everyone for your contributions, support and patience. It's been a
journey and a half, and I'm excited for the future. I will open a follow-on PR
to address the current known failure
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22209
Sorry, but is my biggest pet peeve. Your PR title still only explains the
problem. "Fix problem X" does not describe the fix.
---
Github user gerashegalov commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r212696259
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -2062,8 +2062,10 @@ private[spark] object Utils extends Logging {
try {
Github user gerashegalov commented on a diff in the pull request:
https://github.com/apache/spark/pull/22213#discussion_r212695364
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -2062,8 +2062,10 @@ private[spark] object Utils extends Logging {
try {
Github user movrsprbp commented on the issue:
https://github.com/apache/spark/pull/22189
Sorry, haven't noticed any other current typos.
There was one with "processs" but it got fixed even before I had time to
report it.
-- Původnà e-mail --
Od:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22138
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95206/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22138
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22138
**[Test build #95206 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95206/testReport)**
for PR 22138 at commit
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/3#discussion_r212693216
--- Diff: docs/configuration.md ---
@@ -1925,6 +1925,14 @@ showDF(properties, numRows = 200, truncate = FALSE)
first batch when the backpressure
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/3#discussion_r212692983
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala
---
@@ -141,10 +143,9 @@ private[spark]
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/3#discussion_r212691622
--- Diff:
external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala
---
@@ -141,10 +143,9 @@ private[spark]
Github user koeninger commented on a diff in the pull request:
https://github.com/apache/spark/pull/3#discussion_r212691455
--- Diff: docs/configuration.md ---
@@ -1925,6 +1925,14 @@ showDF(properties, numRows = 200, truncate = FALSE)
first batch when the backpressure
Github user koeninger commented on the issue:
https://github.com/apache/spark/pull/3
Jenkins, ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/3
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rezasafi commented on the issue:
https://github.com/apache/spark/pull/3
@koeninger @arzt will appreciate your feedback here. Thank you in advance.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/3
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/3
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user rezasafi opened a pull request:
https://github.com/apache/spark/pull/3
SPARK-25233. Give the user the option of specifying a fixed minimum message
per partition per batch when using kafka direct API with backpressure
After SPARK-18371, it is guaranteed that there
Github user ankuriitg commented on a diff in the pull request:
https://github.com/apache/spark/pull/22209#discussion_r212688205
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -350,11 +350,16 @@ private[spark] class AppStatusListener(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22209
**[Test build #95218 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95218/testReport)**
for PR 22209 at commit
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/20637#discussion_r212683385
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala
---
@@ -223,8 +223,9 @@ trait
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95207/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95207 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95207/testReport)**
for PR 22112 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/2
**[Test build #95217 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95217/testReport)**
for PR 2 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/2
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/2
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22206#discussion_r212676265
--- Diff: python/pyspark/sql/tests.py ---
@@ -6394,6 +6394,17 @@ def test_invalid_args(self):
df.withColumn('mean_v',
GitHub user xuanyuanking opened a pull request:
https://github.com/apache/spark/pull/2
[SPARK-25083][SQL] Remove the type erasure hack in data source scan
## What changes were proposed in this pull request?
1. Add function `inputBatchRDDs` and `inputRowRDDs` interface
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/21320
Sure, @gatorsmile !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/1
**[Test build #95216 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95216/testReport)**
for PR 1 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/1
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mdespriee commented on the issue:
https://github.com/apache/spark/pull/17461
Hi @sprintcheng,
This PR is stale and is not even mergeable. I haven't had any feedback from
spark maintainers since more than a year. @hhbyyh suggested to wait for #18610
which is also
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/1
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/1
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/1
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user erikerlandson commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212668742
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -225,6 +225,18 @@ private[spark] object
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20637#discussion_r212668425
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala
---
@@ -223,8 +223,9 @@ trait
GitHub user pgandhi999 opened a pull request:
https://github.com/apache/spark/pull/1
[SPARK-25231] : Executor Heartbeat Receiver does not need to synchronâ¦
â¦ize on the TaskSchedulerImpl object
Running a large Spark job with speculation turned on was causing executor
Github user misutoth closed the pull request at:
https://github.com/apache/spark/pull/21591
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/22183
We need to backport it. Without this PR, we cannot solve the data issue in
[SPARK-25206] Wrong data may be returned when enable pushdown.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22183
**[Test build #95215 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95215/testReport)**
for PR 22183 at commit
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22219#discussion_r212664629
--- Diff:
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala
---
@@ -289,6 +289,19 @@
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22219#discussion_r212664660
--- Diff:
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala
---
@@ -289,6 +289,19 @@
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22219#discussion_r212664399
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala ---
@@ -348,30 +350,30 @@ abstract class SparkPlan extends
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22219#discussion_r212664064
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -3237,6 +3237,20 @@ class Dataset[T] private[sql](
files.toSet.toArray
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22216#discussion_r212663909
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala
---
@@ -35,28 +35,38 @@ case class
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22219
Did you verify this feature manually?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22183
+1 to backport this. I think it's a bug that we don't respect
case-sensitive config when resolving parquet fields.
---
-
To
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22183
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22184#discussion_r212662840
--- Diff: docs/sql-programming-guide.md ---
@@ -1895,6 +1895,10 @@ working with timestamps in `pandas_udf`s to get the
best performance, see
-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95214 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95214/testReport)**
for PR 22112 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r212654715
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -812,11 +813,13 @@ abstract class RDD[T: ClassTag](
*/
private[spark]
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r212654451
--- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala ---
@@ -1865,6 +1871,51 @@ abstract class RDD[T: ClassTag](
// RDD chain.
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21698
Thanks everyone! I closed this in favor of #22112
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95213 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95213/testReport)**
for PR 22112 at commit
Github user jiangxb1987 closed the pull request at:
https://github.com/apache/spark/pull/21698
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r212653282
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1502,6 +1502,53 @@ private[spark] class DAGScheduler(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21732
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21732
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2530/
---
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r212651948
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchangeExec.scala
---
@@ -305,17 +306,19 @@ object
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21732
**[Test build #95212 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95212/testReport)**
for PR 21732 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95211 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95211/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95211/
Test PASSed.
---
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/22211
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/20637#discussion_r212649063
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala
---
@@ -223,8 +223,9 @@ trait
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2530/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95211 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95211/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2528/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95210 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95210/testReport)**
for PR 22112 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95204/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22205
**[Test build #95204 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95204/testReport)**
for PR 22205 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20637
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20637
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95205/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20637
**[Test build #95205 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95205/testReport)**
for PR 20637 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2528/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22216
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22216
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95203/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22216
**[Test build #95203 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95203/testReport)**
for PR 22216 at commit
301 - 400 of 541 matches
Mail list logo