Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16990
**[Test build #73205 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73205/testReport)**
for PR 16990 at commit
Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/17000
Is the speedup coming mostly from the `MultivariateOnlineSummarizer` stage?
See https://issues.apache.org/jira/browse/SPARK-19634 which is for porting
this operation to use DataFrame UDAF
Github user windpiger commented on the issue:
https://github.com/apache/spark/pull/17001
cc @gatorsmile @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17001
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17001
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73201/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17001
**[Test build #73201 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73201/testReport)**
for PR 17001 at commit
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/16949
cc @srowen also.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/16971#discussion_r102146260
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala
---
@@ -78,7 +80,13 @@ object StatFunctions extends Logging {
Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/16971#discussion_r102145908
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala ---
@@ -89,18 +89,17 @@ final class DataFrameStatFunctions
Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/16971#discussion_r102145412
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala
---
@@ -54,6 +54,8 @@ object StatFunctions extends Logging {
Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/16971#discussion_r102145538
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala ---
@@ -89,18 +89,17 @@ final class DataFrameStatFunctions
Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/16971#discussion_r102146144
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/DataFrameStatSuite.scala ---
@@ -214,20 +214,29 @@ class DataFrameStatSuite extends QueryTest with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16594
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16594
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73200/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16594
**[Test build #73200 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73200/testReport)**
for PR 16594 at commit
Github user ZunwenYou commented on the issue:
https://github.com/apache/spark/pull/17000
Hi, @hhbyyh
In our experiment, the class **_MultivariateOnlineSummarizer_** contains 8
arrays, if the dimension reaches 20 million, the memory of
MultivariateOnlineSummarizer is
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102143747
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala ---
@@ -217,7 +217,8 @@ class HiveSparkSubmitSuite
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102143663
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSessionStateSuite.scala
---
@@ -0,0 +1,54 @@
+/*
+ * Licensed to the Apache
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17009
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17009
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73199/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17009
**[Test build #73199 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73199/testReport)**
for PR 17009 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16826
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16826
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73202/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16826
**[Test build #73202 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73202/testReport)**
for PR 16826 at commit
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102142543
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
---
@@ -117,9 +122,11 @@ class SparkSession private(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17005
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17005
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73203/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17005
**[Test build #73203 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73203/testReport)**
for PR 17005 at commit
Github user hhbyyh commented on a diff in the pull request:
https://github.com/apache/spark/pull/11601#discussion_r102141627
--- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/Imputer.scala ---
@@ -0,0 +1,225 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user hhbyyh commented on the issue:
https://github.com/apache/spark/pull/16020
Close this as it's better resolved in
https://issues.apache.org/jira/browse/SPARK-18608.
Thanks for the comments and discussion.
---
If your project is set up for it, you can reply to this
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16979#discussion_r102141431
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala
---
@@ -63,8 +63,34 @@ class HDFSMetadataLog[T <: AnyRef
Github user hhbyyh closed the pull request at:
https://github.com/apache/spark/pull/16020
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user srowen closed the pull request at:
https://github.com/apache/spark/pull/17003
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73204/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17010
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17010
**[Test build #73204 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73204/testReport)**
for PR 17010 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102141351
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/ExperimentalMethods.scala ---
@@ -46,4 +46,10 @@ class ExperimentalMethods private[sql]() {
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17003
(@srowen just a kind reminder that it seems not closed..)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102140755
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala ---
@@ -22,38 +22,58 @@ import java.io.File
import
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17006
For adding a test, I usually go to the blame button and check where the
tests were added in the recent commits. It seems `FilteredScanSuite` is the
right place assuming from
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17010
**[Test build #73204 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73204/testReport)**
for PR 17010 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/17010
cc @watermen @yhuai @liancheng since this PR is related to
https://github.com/apache/spark/pull/7030
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/17010
ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16594#discussion_r102138925
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala
---
@@ -54,11 +57,29 @@ case class Statistics(
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16594#discussion_r102138379
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala
---
@@ -54,11 +57,29 @@ case class Statistics(
Github user 10110346 closed the pull request at:
https://github.com/apache/spark/pull/17007
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16997
You are still bold-facing code elements, and now back-ticked a string,
which isn't code. There are still typos like "create dataset" instead of
"create a Dataset". Do you mean to write something to
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16594#discussion_r102137730
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/commands.scala
---
@@ -92,7 +92,8 @@ case class ExecutedCommandExec(cmd:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16594#discussion_r102137661
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala ---
@@ -282,7 +282,8 @@ class SparkSqlAstBuilder(conf: SQLConf)
Github user kunalkhamar commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102137355
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala
---
@@ -1178,4 +1178,34 @@ class SessionCatalog(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17005
**[Test build #73203 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73203/testReport)**
for PR 17005 at commit
Github user kunalkhamar commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102137396
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala ---
@@ -217,6 +217,7 @@ class HiveSparkSubmitSuite
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16594#discussion_r102137390
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala ---
@@ -197,20 +197,32 @@ class QueryExecution(val sparkSession:
Github user ndimiduk commented on the issue:
https://github.com/apache/spark/pull/17006
Thanks for having a look @HyukjinKwon. I agree a test is needed. I'm new to
Spark code base, so please direct me -- I assume there's an existing suite or
suites that I can extend with coverage for
Github user actuaryzhang commented on the issue:
https://github.com/apache/spark/pull/17005
@HyukjinKwon Thanks. I'll try retesting this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16594#discussion_r102137142
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala
---
@@ -54,11 +57,29 @@ case class Statistics(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16826
**[Test build #73202 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73202/testReport)**
for PR 16826 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17001
**[Test build #73201 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73201/testReport)**
for PR 17001 at commit
Github user lvdongr commented on the issue:
https://github.com/apache/spark/pull/17010
Before spark1.4.x, the ThriftServer name is "SparkSQL:localhostname",while
https://issues.apache.org/jira/browse/SPARK-8650 change the rule as a side
effect. Then the ThriftServer show the class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16996
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73198/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16996
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16996
**[Test build #73198 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73198/testReport)**
for PR 16996 at commit
Github user HarshSharma8 commented on the issue:
https://github.com/apache/spark/pull/16997
Hello Sean,
I have updated the content with back-ticks, Can you have a look at this ?
And i am not getting which object-name you are asking about.
Thank You
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16594
**[Test build #73200 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73200/testReport)**
for PR 16594 at commit
Github user HarshSharma8 commented on the issue:
https://github.com/apache/spark/pull/16997
Hello Sean,
I apologize for bold instead of back-ticks, and i'm updating the content
for this.
Thank You
Best Regards |
*Harsh Sharma*
Sr. Software
Github user zjffdu commented on the issue:
https://github.com/apache/spark/pull/11211
ping @holdenk @HyukjinKwon PR is updated, please help review. Thanks
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17010
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16999
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16851
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16851
Thanks! @srowen
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user lvdongr opened a pull request:
https://github.com/apache/spark/pull/17010
[SPARK-19673][SQL] "ThriftServer default app name is changed wrong"
## What changes were proposed in this pull request?
In spark 1.x ,the name of ThriftServer is SparkSQL:localHostName. While
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16997
BTW, could we maybe make the title complete (not `operaâ¦`)?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16999
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16997#discussion_r102134319
--- Diff: docs/sql-programming-guide.md ---
@@ -297,6 +297,9 @@ reflection and become the names of the columns. Case
classes can also be nested
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16851
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17009
**[Test build #73199 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73199/testReport)**
for PR 17009 at commit
Github user carsonwang commented on the issue:
https://github.com/apache/spark/pull/17009
cc @cloud-fan @zsxwing
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17005
(It seems it was due to
https://github.com/apache/spark/commit/73f065569d352081b7d64c254af70ce996860c53.)
---
If your project is set up for it, you can reply to this email and have your
reply
Github user ron8hu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16395#discussion_r102133390
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/FilterEstimationSuite.scala
---
@@ -0,0 +1,389 @@
+/*
+ *
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16995#discussion_r102133102
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -374,34 +374,42 @@ case class DataSource(
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/16750#discussion_r102132903
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/sources/ResolvedDataSourceSuite.scala
---
@@ -19,11 +19,15 @@ package org.apache.spark.sql.sources
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/16750#discussion_r102132850
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala
---
@@ -859,6 +859,48 @@ class CSVSuite extends QueryTest
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17007
This is too trivial -- we have generally rejected changes like this. If you
would, please close this and the JIRA. Have a look at
http://spark.apache.org/contributing.html too
---
If your project
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16910
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73196/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16910
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16910
**[Test build #73196 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73196/testReport)**
for PR 16910 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16910
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16910
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73194/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16910
**[Test build #73194 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73194/testReport)**
for PR 16910 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16910
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73193/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16910
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16910
**[Test build #73193 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73193/testReport)**
for PR 16910 at commit
Github user windpiger commented on the issue:
https://github.com/apache/spark/pull/17008
passed localyï¼ retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/16826#discussion_r102130841
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala ---
@@ -217,6 +217,7 @@ class HiveSparkSubmitSuite
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17006
See
https://github.com/apache/spark/blob/7730426cb95eec2652a9ea979ae2c4faf7e585f2/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala#L158-L160
too.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17006
BTW, even if we push the dot-separated names, this would not support the
push-down in Parquet because `ParquetFilters` itself does not handle nested
columns (see
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16996
cc @yhuai who did the original change. I am not sure whether we need to
overwrite the original value of hadoopConf, although the change does not hurt
anything IMO.
---
If your project is set
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17008
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17008
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73192/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17008
**[Test build #73192 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73192/testReport)**
for PR 17008 at commit
1 - 100 of 394 matches
Mail list logo
