Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22507
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22362
@vanzin any further comments?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21688
**[Test build #96557 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96557/testReport)**
for PR 21688 at commit
Github user adrian555 commented on the issue:
https://github.com/apache/spark/pull/22455
@falaki trying to understand what you were asking for. I know that `print`
takes some arguments like `digit` and `quote` that can further format the
output. `print` is for S3 object and `show` is
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22520
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22546
**[Test build #96555 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96555/testReport)**
for PR 22546 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21322
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22546
**[Test build #4351 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4351/testReport)**
for PR 22546 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22503
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96556/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22503
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22362
**[Test build #96572 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96572/testReport)**
for PR 22362 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22362
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3450/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22540
**[Test build #96558 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96558/testReport)**
for PR 22540 at commit
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22379#discussion_r220345504
--- Diff: sql/core/src/test/resources/sql-tests/inputs/csv-functions.sql ---
@@ -0,0 +1,12 @@
+-- from_csv
+describe function from_csv;
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22379#discussion_r220345402
--- Diff: sql/core/src/test/resources/sql-tests/inputs/csv-functions.sql ---
@@ -0,0 +1,12 @@
+-- from_csv
+describe function from_csv;
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22520
Yeah, I like your suggestion to just have one code path here that works for
all platforms. No need to have used `PosixFilePermissions` in the first place
as there was a utility method for setting
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22503
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22503
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96559/
Test PASSed.
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22540
Although it's PySpark failure, but it looks irrelevant to this.
```
#
# A fatal error has been detected by the Java Runtime Environment:
#
# Internal Error
Github user jianjianjiao commented on the issue:
https://github.com/apache/spark/pull/22520
@srowen Thanks for confirmation. I have sent out new iteration. Could you
please authorize testing on this.
---
-
To
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22325
**[Test build #96565 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96565/testReport)**
for PR 22325 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22325
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96565/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22198
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96562/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22198
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22546
**[Test build #96561 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96561/testReport)**
for PR 22546 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22540#discussion_r220363870
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowUtils.scala
---
@@ -131,11 +131,8 @@ object ArrowUtils {
} else {
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22484
I made an official PR for `withSQLConf`
[SPARK-25534](https://github.com/apache/spark/pull/22548) which reduces the
number of `withSQLConf` from 6 to 3. The three were the minimal different
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22528
@gatorsmile Please, take a look at the PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96576 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96576/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22379
**[Test build #96573 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96573/testReport)**
for PR 22379 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22362
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22362
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3450/
---
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22379#discussion_r220346397
--- Diff: R/pkg/NAMESPACE ---
@@ -275,6 +275,7 @@ exportMethods("%<=>%",
"format_number",
"format_string",
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22362
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22540
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22540
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22540
**[Test build #96574 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96574/testReport)**
for PR 22540 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96557/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/22362#discussion_r220356187
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -726,7 +726,11 @@ private[spark] object SparkConf extends Logging {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22325
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22198
**[Test build #96562 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96562/testReport)**
for PR 22198 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22362
**[Test build #96578 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96578/testReport)**
for PR 22362 at commit
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22442
@rxin @HyukjinKwon @gatorsmile Can we move forward with the PR without
throwing an exception for ignored options by `schema_of_json()`?
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22546
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22546
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96555/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22540
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96558/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22540
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22379#discussion_r220345834
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/CsvFunctionsSuite.scala ---
@@ -0,0 +1,74 @@
+/*
+ * Licensed to the Apache Software
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22503
**[Test build #96559 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96559/testReport)**
for PR 22503 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22326
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22326
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96560/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22326
**[Test build #96560 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96560/testReport)**
for PR 22326 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22362#discussion_r220354878
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -726,7 +726,11 @@ private[spark] object SparkConf extends Logging {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22520
**[Test build #96575 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96575/testReport)**
for PR 22520 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22546
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96561/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22546
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22548
[SPARK-25534][SQL] Make `SupportWithSQLConf` trait
## What changes were proposed in this pull request?
Currently, Spark has 6 `withSQLConf` function. This PR aims to remove
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22548
Could you review this PR, @cloud-fan , @gatorsmile , and @wangyum ?
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22362
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3452/
---
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22237
@HyukjinKwon Any chance the PR will be merged in the near future or I
should close it?
---
-
To unsubscribe, e-mail:
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22429
As far as I know, @hvanhovell, you would prefer replacing `Option[Int]` by
just `Int` in `simpleString` and other similar places. I can do that but I have
to read the config parameter in all those
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22503
**[Test build #96556 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96556/testReport)**
for PR 22503 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22540
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22362#discussion_r220360201
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -726,7 +726,11 @@ private[spark] object SparkConf extends Logging {
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/22362#discussion_r220364426
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -726,7 +726,11 @@ private[spark] object SparkConf extends Logging {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96577 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96577/testReport)**
for PR 22504 at commit
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22326
```
move this rule to optimizer, as the last batch (but before the
UpdateAttributeReferences batch). Since we apply this rule after filter
pushdown, we can simply pull out any python udf
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22494
**[Test build #96533 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96533/testReport)**
for PR 22494 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22541
**[Test build #96535 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96535/testReport)**
for PR 22541 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22198
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96536/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22521
**[Test build #96534 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96534/testReport)**
for PR 22521 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22198
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22521
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96534/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22521
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22198
**[Test build #96536 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96536/testReport)**
for PR 22198 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22543
cc @rxin @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/22543
[SPARK-23715][SQL] improve document for from/to_utc_timestamp
## What changes were proposed in this pull request?
We have an agreement that the behavior of `from/to_utc_timestamp` is
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22326
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22326
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22518
@mgaido91 Sorry but can you have a more detailed explanation in the PR
description?
With the code changes, the predicate with subquery result can be push down
into data source. Is this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22326
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96543/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22326
**[Test build #96543 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96543/testReport)**
for PR 22326 at commit
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22534#discussion_r220104540
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala
---
@@ -113,6 +113,11 @@ private[sql] class JSONOptions(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22326
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22326#discussion_r220110490
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1234,6 +1237,59 @@ object PushPredicateThroughJoin
GitHub user dilipbiswal opened a pull request:
https://github.com/apache/spark/pull/22544
[SPARK-25522] Improve type promotion for input arguments of elementAt
function
## What changes were proposed in this pull request?
In ElementAt, when first argument is MapType, we should
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22544
**[Test build #96544 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96544/testReport)**
for PR 22544 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22544
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22326#discussion_r220111919
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1234,6 +1237,59 @@ object
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22544
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22534
**[Test build #96545 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96545/testReport)**
for PR 22534 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22494
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96533/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22494
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22541
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22541
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96535/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22521
**[Test build #96538 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96538/testReport)**
for PR 22521 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22494
**[Test build #96539 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96539/testReport)**
for PR 22494 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22541
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22521
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
1 - 100 of 624 matches
Mail list logo
