Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22470
@cloud-fan I think the main problem about this (and it is the reason why I
haven't proposed it) is that the range of operations supported would be
smaller, so we may forbid operations which now
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22465
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22173
also please fix jira number, should be SPARK-24355
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22413
@dongjoon-hyun It cannot be merged to 2.3 easily because
`DataSourceV2Relation` doesn't have the `options` field, and the test for read
is not compilable. I will try to fix it tomorrow.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22460
**[Test build #96292 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96292/testReport)**
for PR 22460 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96293 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96293/testReport)**
for PR 22173 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96291 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96291/testReport)**
for PR 22173 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96264 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96264/testReport)**
for PR 22173 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96264/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dilipbiswal commented on the issue:
https://github.com/apache/spark/pull/22470
@mgaido91 @cloud-fan On the other hand .. some use cases may work better
:-) , for example
Before
```
scala> spark.sql("create table dec as select (1e36 * 1) as col1")
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22475
**[Test build #96298 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96298/testReport)**
for PR 22475 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/22476
cc @tdas @marmbrus @jose-torres
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/22477
[SPARK-25471][PYTHON][TEST] Fix pyspark-sql test error when using Python
3.6 and Pandas 0.23
## What changes were proposed in this pull request?
Fix test that constructs a Pandas
GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/22476
[SPARK-24157] spark.sql.streaming.noDataMicroBatches.enabled
## What changes were proposed in this pull request?
This patch changes the config option
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22475
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22475
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22477
**[Test build #96299 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96299/testReport)**
for PR 22477 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22476
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/22449
LGTM. Merged into master and branch-2.4. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/22376
For future reference the original PR is at
https://github.com/apache/spark/pull/22298/files/fe8cc5aa6759cdf893e11c3d83814f8dffddce9c
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22376
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3265/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22477
**[Test build #96306 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96306/testReport)**
for PR 22477 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22478
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96273/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96273 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96273/testReport)**
for PR 22173 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22477
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96306/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22478
**[Test build #96308 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96308/testReport)**
for PR 22478 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22477
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22477
**[Test build #96306 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96306/testReport)**
for PR 22477 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22478
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22461
Oh, I am not aware of it.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22325
**[Test build #96285 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96285/testReport)**
for PR 22325 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96255 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96255/testReport)**
for PR 22173 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96255/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96259 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96259/testReport)**
for PR 22173 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22138
**[Test build #96295 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96295/testReport)**
for PR 22138 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96259/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22460
**[Test build #96296 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96296/testReport)**
for PR 22460 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22472
Thank you, @rxin . Then, I'll proceed it .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22402
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/22475
[SPARK-4502][SQL] spark.sql.optimizer.nestedSchemaPruning.enabled
## What changes were proposed in this pull request?
This patch adds an "optimizer" prefix to nested schema pruning.
##
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/22475
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22138
**[Test build #96300 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96300/testReport)**
for PR 22138 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22376
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22376
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22376
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3265/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22473
**[Test build #96303 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96303/testReport)**
for PR 22473 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22376
**[Test build #96304 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96304/testReport)**
for PR 22376 at commit
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/22376
Jenkins retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/22476
LGTM.
Please make sure to merge it to 2.4
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/22478
LGTM pending tests. Could you add `[SS]` to your title?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/22478
Lgtm pending tests
On Wed, Sep 19, 2018 at 5:16 PM Shixiong Zhu
wrote:
> LGTM pending tests. Could you add [SS] to your title?
>
> â
> You are receiving this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22465
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96287/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22465
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22476
**[Test build #96297 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96297/testReport)**
for PR 22476 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22470
@mgaido91 you are right, this still has behavior changes if the intermedia
result exceed the max precision. Since most of the storages don't support
negative scale(hive, parquet, etc.), I think
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96291 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96291/testReport)**
for PR 22173 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22447
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96280/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22447
**[Test build #96280 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96280/testReport)**
for PR 22447 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22477
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96299/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22473
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96301/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22477
**[Test build #96299 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96299/testReport)**
for PR 22477 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22477
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user redsanket commented on the issue:
https://github.com/apache/spark/pull/22173
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #96305 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96305/testReport)**
for PR 22173 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22472
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96278/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22472
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22474
Since it's merged, could you close this PR?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22325
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22325
**[Test build #96285 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96285/testReport)**
for PR 22325 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22475
**[Test build #96298 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96298/testReport)**
for PR 22475 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22475
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22475
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22460
**[Test build #4344 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4344/testReport)**
for PR 22460 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22465#discussion_r219011641
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1561,6 +1561,13 @@ object SQLConf {
"are performed
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/22476
Merged in master/2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22358#discussion_r219015195
--- Diff: docs/sql-programming-guide.md ---
@@ -965,6 +965,8 @@ Configuration of Parquet can be done using the
`setConf` method on `SparkSession
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96270/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19045
**[Test build #96290 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96290/testReport)**
for PR 19045 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22465
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22465
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22450
**[Test build #96289 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96289/testReport)**
for PR 22450 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22469
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22460
**[Test build #96288 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96288/testReport)**
for PR 22460 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22469
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22460
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/22138#discussion_r218955883
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaConsumerPool.scala
---
@@ -0,0 +1,241 @@
+/*
+ *
1 - 100 of 919 matches
Mail list logo