SparkQA removed a comment on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658106124
**[Test build #125825 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125825/testReport)**
for PR 29102 at commit
SparkQA commented on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658200228
**[Test build #125825 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125825/testReport)**
for PR 29102 at commit
cloud-fan commented on a change in pull request #27428:
URL: https://github.com/apache/spark/pull/27428#discussion_r454391588
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala
##
@@ -102,23 +102,127 @@ import
AmplabJenkins commented on pull request #29085:
URL: https://github.com/apache/spark/pull/29085#issuecomment-658215008
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #29002:
URL: https://github.com/apache/spark/pull/29002#issuecomment-658239160
**[Test build #125831 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125831/testReport)**
for PR 29002 at commit
stczwd commented on pull request #28280:
URL: https://github.com/apache/spark/pull/28280#issuecomment-658243169
kindly remind @rdblue @cloud-fan @xuanyuanking.
This is an automated message from the Apache Git Service.
To
gaborgsomogyi commented on pull request #29024:
URL: https://github.com/apache/spark/pull/29024#issuecomment-658258741
As I see the unit tests passed removing the WIP.
This is an automated message from the Apache Git
AmplabJenkins commented on pull request #29100:
URL: https://github.com/apache/spark/pull/29100#issuecomment-658259487
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
ScrapCodes commented on pull request #28423:
URL: https://github.com/apache/spark/pull/28423#issuecomment-658153445
> > BTW, when do we receive a version changed from K8s?
>
> It happens when etcd compaction kicks in for example. On aws EKS I never
saw this happening on EKS 1.14,
SparkQA commented on pull request #29002:
URL: https://github.com/apache/spark/pull/29002#issuecomment-658153415
**[Test build #125831 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125831/testReport)**
for PR 29002 at commit
SparkQA commented on pull request #28939:
URL: https://github.com/apache/spark/pull/28939#issuecomment-658153432
**[Test build #125832 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125832/testReport)**
for PR 28939 at commit
AmplabJenkins removed a comment on pull request #28287:
URL: https://github.com/apache/spark/pull/28287#issuecomment-658180547
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #28917:
URL: https://github.com/apache/spark/pull/28917#issuecomment-658099896
**[Test build #125822 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125822/testReport)**
for PR 28917 at commit
AmplabJenkins commented on pull request #28917:
URL: https://github.com/apache/spark/pull/28917#issuecomment-658181969
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
ulysses-you commented on a change in pull request #28840:
URL: https://github.com/apache/spark/pull/28840#discussion_r454365461
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala
##
@@ -3030,6 +3030,47 @@ abstract class DDLSuite
AmplabJenkins removed a comment on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658235055
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #28939:
URL: https://github.com/apache/spark/pull/28939#issuecomment-658251544
**[Test build #125832 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125832/testReport)**
for PR 28939 at commit
SparkQA commented on pull request #29088:
URL: https://github.com/apache/spark/pull/29088#issuecomment-658160091
**[Test build #125833 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125833/testReport)**
for PR 29088 at commit
AmplabJenkins removed a comment on pull request #29098:
URL: https://github.com/apache/spark/pull/29098#issuecomment-658167831
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #29098:
URL: https://github.com/apache/spark/pull/29098#issuecomment-658167831
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #29067:
URL: https://github.com/apache/spark/pull/29067#issuecomment-658172413
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658179738
**[Test build #125837 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125837/testReport)**
for PR 29102 at commit
SparkQA commented on pull request #28287:
URL: https://github.com/apache/spark/pull/28287#issuecomment-658179776
**[Test build #125838 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125838/testReport)**
for PR 28287 at commit
tgravescs commented on pull request #28874:
URL: https://github.com/apache/spark/pull/28874#issuecomment-658179951
@xkrogen unfortunately it appears there is another conflict could you update
again?
This is an automated
beliefer commented on a change in pull request #27428:
URL: https://github.com/apache/spark/pull/27428#discussion_r454386912
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteDistinctAggregates.scala
##
@@ -102,23 +102,127 @@ import
AngersZh commented on pull request #29085:
URL: https://github.com/apache/spark/pull/29085#issuecomment-658223626
> What's the behavior of hive if the script transformation doesn't specify a
serde? Does Hive pick a default serde, or it well defines the behavior of
non-serde?
In
AmplabJenkins commented on pull request #28874:
URL: https://github.com/apache/spark/pull/28874#issuecomment-658249130
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
xkrogen commented on pull request #28874:
URL: https://github.com/apache/spark/pull/28874#issuecomment-658248814
Playing a game of whack-a-mole here :) Thanks for the heads up @tgravescs .
Pushed up another conflict resolution.
AmplabJenkins removed a comment on pull request #29104:
URL: https://github.com/apache/spark/pull/29104#issuecomment-658256117
Can one of the admins verify this patch?
This is an automated message from the Apache Git
AmplabJenkins commented on pull request #29104:
URL: https://github.com/apache/spark/pull/29104#issuecomment-658256805
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To
AmplabJenkins removed a comment on pull request #29098:
URL: https://github.com/apache/spark/pull/29098#issuecomment-658140318
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #29098:
URL: https://github.com/apache/spark/pull/29098#issuecomment-658140318
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #29024:
URL: https://github.com/apache/spark/pull/29024#issuecomment-658069123
**[Test build #125820 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125820/testReport)**
for PR 29024 at commit
AmplabJenkins commented on pull request #29103:
URL: https://github.com/apache/spark/pull/29103#issuecomment-658146644
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #29024:
URL: https://github.com/apache/spark/pull/29024#issuecomment-658146504
**[Test build #125820 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125820/testReport)**
for PR 29024 at commit
wangyum commented on a change in pull request #29088:
URL: https://github.com/apache/spark/pull/29088#discussion_r454328505
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVOptions.scala
##
@@ -135,6 +135,8 @@ class CSVOptions(
val positiveInf
wangyum commented on a change in pull request #29088:
URL: https://github.com/apache/spark/pull/29088#discussion_r454328241
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala
##
@@ -2353,6 +2355,53 @@ abstract class CSVSuite
MrPowers commented on pull request #23877:
URL: https://github.com/apache/spark/pull/23877#issuecomment-658165960
@Hellsen83 - I updated [the blog
post](https://mungingdata.com/pyspark/chaining-dataframe-transformations/) to
add your suggested convention of using `_` as the inner function
AmplabJenkins commented on pull request #29067:
URL: https://github.com/apache/spark/pull/29067#issuecomment-658172413
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #29090:
URL: https://github.com/apache/spark/pull/29090#issuecomment-658184244
**[Test build #125826 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125826/testReport)**
for PR 29090 at commit
SparkQA commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-658211083
**[Test build #125841 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125841/testReport)**
for PR 28412 at commit
SparkQA commented on pull request #29085:
URL: https://github.com/apache/spark/pull/29085#issuecomment-658211049
**[Test build #125840 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125840/testReport)**
for PR 29085 at commit
AmplabJenkins commented on pull request #28412:
URL: https://github.com/apache/spark/pull/28412#issuecomment-658211580
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins commented on pull request #28917:
URL: https://github.com/apache/spark/pull/28917#issuecomment-658211690
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
cloud-fan commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454396181
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcUtils.scala
##
@@ -116,47 +116,53 @@ object OrcUtils extends
beliefer commented on pull request #28917:
URL: https://github.com/apache/spark/pull/28917#issuecomment-658210689
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please
AmplabJenkins commented on pull request #29085:
URL: https://github.com/apache/spark/pull/29085#issuecomment-658211620
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658235069
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
leanken opened a new pull request #29104:
URL: https://github.com/apache/spark/pull/29104
### What changes were proposed in this pull request?
Normally, a NotInSubquery will be planed into BroadcastNestedLoopJoin which
is very time consuming, for instance, in TPCH Query 16.
```
SparkQA removed a comment on pull request #29098:
URL: https://github.com/apache/spark/pull/29098#issuecomment-658053443
**[Test build #125815 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125815/testReport)**
for PR 29098 at commit
SparkQA commented on pull request #29098:
URL: https://github.com/apache/spark/pull/29098#issuecomment-658139766
**[Test build #125815 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125815/testReport)**
for PR 29098 at commit
gaborgsomogyi removed a comment on pull request #29024:
URL: https://github.com/apache/spark/pull/29024#issuecomment-658147329
retest this pleases
This is an automated message from the Apache Git Service.
To respond to the
gaborgsomogyi commented on pull request #29024:
URL: https://github.com/apache/spark/pull/29024#issuecomment-658149363
retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
cloud-fan commented on a change in pull request #28840:
URL: https://github.com/apache/spark/pull/28840#discussion_r454336315
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala
##
@@ -3030,6 +3030,47 @@ abstract class DDLSuite extends
cloud-fan commented on a change in pull request #28840:
URL: https://github.com/apache/spark/pull/28840#discussion_r454336540
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/functions.scala
##
@@ -236,6 +236,46 @@ case class ShowFunctionsCommand(
AmplabJenkins commented on pull request #28840:
URL: https://github.com/apache/spark/pull/28840#issuecomment-658164151
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28840:
URL: https://github.com/apache/spark/pull/28840#issuecomment-658164151
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658171151
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
attilapiros commented on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658179166
retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
AmplabJenkins commented on pull request #28840:
URL: https://github.com/apache/spark/pull/28840#issuecomment-658189140
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28840:
URL: https://github.com/apache/spark/pull/28840#issuecomment-658189140
This is an automated message from the Apache Git Service.
To respond to the message, please log on
stijndehaes commented on pull request #28423:
URL: https://github.com/apache/spark/pull/28423#issuecomment-658205704
> > > BTW, when do we receive a version changed from K8s?
> >
> >
> > It happens when etcd compaction kicks in for example. On aws EKS I never
saw this happening
koeninger commented on pull request #21038:
URL: https://github.com/apache/spark/pull/21038#issuecomment-658234795
Why can't you use a different group id?
This is an automated message from the Apache Git Service.
To respond
srowen commented on a change in pull request #29088:
URL: https://github.com/apache/spark/pull/29088#discussion_r454436084
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CsvOutputWriter.scala
##
@@ -39,6 +39,10 @@ class CsvOutputWriter(
AmplabJenkins removed a comment on pull request #29002:
URL: https://github.com/apache/spark/pull/29002#issuecomment-658240283
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #29002:
URL: https://github.com/apache/spark/pull/29002#issuecomment-658240267
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins commented on pull request #29002:
URL: https://github.com/apache/spark/pull/29002#issuecomment-658240267
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
attilapiros commented on pull request #29102:
URL: https://github.com/apache/spark/pull/29102#issuecomment-658248290
retest this please
This is an automated message from the Apache Git Service.
To respond to the
cloud-fan commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454475026
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala
##
@@ -160,12 +160,12 @@ class OrcFileFormat
cloud-fan commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454476253
##
File path:
sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcQuerySuite.scala
##
@@ -288,4 +288,35 @@ class HiveOrcQuerySuite extends
AmplabJenkins commented on pull request #29105:
URL: https://github.com/apache/spark/pull/29105#issuecomment-658280775
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To
cloud-fan commented on pull request #29085:
URL: https://github.com/apache/spark/pull/29085#issuecomment-658282891
so eventually we don't need to use `Cast` to convert catalyst value to
string? There will always be a serde (default or user-specified).
AmplabJenkins commented on pull request #28708:
URL: https://github.com/apache/spark/pull/28708#issuecomment-658291045
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28708:
URL: https://github.com/apache/spark/pull/28708#issuecomment-658185501
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #29109:
URL: https://github.com/apache/spark/pull/29109#issuecomment-658321561
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To
AmplabJenkins removed a comment on pull request #29110:
URL: https://github.com/apache/spark/pull/29110#issuecomment-658325327
Can one of the admins verify this patch?
This is an automated message from the Apache Git
AmplabJenkins commented on pull request #29089:
URL: https://github.com/apache/spark/pull/29089#issuecomment-658326302
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
aokolnychyi commented on a change in pull request #29089:
URL: https://github.com/apache/spark/pull/29089#discussion_r454541782
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
##
@@ -981,6 +982,10 @@ object EliminateSorts
AmplabJenkins removed a comment on pull request #29089:
URL: https://github.com/apache/spark/pull/29089#issuecomment-658326302
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SaurabhChawla100 commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454558890
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/orc/OrcPartitionReaderFactory.scala
##
@@ -74,7 +74,7 @@
AmplabJenkins commented on pull request #29045:
URL: https://github.com/apache/spark/pull/29045#issuecomment-658351300
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #29045:
URL: https://github.com/apache/spark/pull/29045#issuecomment-658350754
**[Test build #125851 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125851/testReport)**
for PR 29045 at commit
SaurabhChawla100 commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454570883
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcUtils.scala
##
@@ -116,47 +116,53 @@ object OrcUtils
dongjoon-hyun closed pull request #29108:
URL: https://github.com/apache/spark/pull/29108
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
aokolnychyi commented on a change in pull request #29089:
URL: https://github.com/apache/spark/pull/29089#discussion_r454601951
##
File path:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/EliminateSortsBeforeRepartitionSuite.scala
##
@@ -0,0 +1,179 @@
dongjoon-hyun closed pull request #29109:
URL: https://github.com/apache/spark/pull/29109
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
Fokko commented on pull request #29109:
URL: https://github.com/apache/spark/pull/29109#issuecomment-658377938
Thanks for picking this up so quickly @dongjoon-hyun
This is an automated message from the Apache Git Service.
rdblue commented on a change in pull request #29089:
URL: https://github.com/apache/spark/pull/29089#discussion_r454617890
##
File path:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/EliminateSortsBeforeRepartitionSuite.scala
##
@@ -0,0 +1,179 @@
+/*
+ *
SparkQA commented on pull request #29089:
URL: https://github.com/apache/spark/pull/29089#issuecomment-658397973
**[Test build #125847 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125847/testReport)**
for PR 29089 at commit
Ngone51 opened a new pull request #29106:
URL: https://github.com/apache/spark/pull/29106
### What changes were proposed in this pull request?
Override `canonicalized` to empty the `inputEncoders` for the canonicalized
`ScalaUDF`.
### Why are the changes
SaurabhChawla100 commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454491048
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala
##
@@ -160,12 +160,12 @@ class
SparkQA commented on pull request #29107:
URL: https://github.com/apache/spark/pull/29107#issuecomment-658292521
**[Test build #125845 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125845/testReport)**
for PR 29107 at commit
SparkQA commented on pull request #29106:
URL: https://github.com/apache/spark/pull/29106#issuecomment-658292625
**[Test build #125846 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125846/testReport)**
for PR 29106 at commit
SaurabhChawla100 commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454524703
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcUtils.scala
##
@@ -116,47 +116,53 @@ object OrcUtils
SaurabhChawla100 commented on a change in pull request #29045:
URL: https://github.com/apache/spark/pull/29045#discussion_r454524703
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcUtils.scala
##
@@ -116,47 +116,53 @@ object OrcUtils
AmplabJenkins removed a comment on pull request #29108:
URL: https://github.com/apache/spark/pull/29108#issuecomment-658317741
Can one of the admins verify this patch?
This is an automated message from the Apache Git
AmplabJenkins commented on pull request #29108:
URL: https://github.com/apache/spark/pull/29108#issuecomment-658318431
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To
AmplabJenkins removed a comment on pull request #29067:
URL: https://github.com/apache/spark/pull/29067#issuecomment-658317544
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on pull request #29110:
URL: https://github.com/apache/spark/pull/29110#issuecomment-658326014
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #29089:
URL: https://github.com/apache/spark/pull/29089#issuecomment-658325499
**[Test build #125847 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125847/testReport)**
for PR 29089 at commit
301 - 400 of 919 matches
Mail list logo