GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/23091
[SPARK-26122][SQL] Support encoding for multiLine in CSV datasource
## What changes were proposed in this pull request?
In the PR, I propose to pass the CSV option `encoding`/`charset` to
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22305
**[Test build #99022 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99022/testReport)**
for PR 22305 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23087
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23087
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99001/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23072
**[Test build #99028 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99028/testReport)**
for PR 23072 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23072
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/23053
Hm, reviewing this again I think a better way to do it is to only opt-in to
building images of different bindings. So for example the Python image should
only be built when `-p ` is specified. It
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23090
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23090
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99018/
Test FAILed.
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23065
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23025
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23082
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23045
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/23040
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user drewrobb commented on a diff in the pull request:
https://github.com/apache/spark/pull/23062#discussion_r234834125
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
---
@@ -788,12 +788,37 @@ object ScalaReflection extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23087
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22305
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99022/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23062
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23087
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22305
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23062
**[Test build #99033 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99033/testReport)**
for PR 23062 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/23054
@cloud-fan Yea, it's resolved. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23081
**[Test build #99024 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99024/testReport)**
for PR 23081 at commit
Github user drewrobb commented on a diff in the pull request:
https://github.com/apache/spark/pull/23062#discussion_r234854202
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
---
@@ -788,12 +788,37 @@ object ScalaReflection extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22305
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22305
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23084
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99002/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23087
**[Test build #99001 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99001/testReport)**
for PR 23087 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23084
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user huaxingao commented on the issue:
https://github.com/apache/spark/pull/23072
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23072
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99011/
Test PASSed.
---
Github user bersprockets commented on a diff in the pull request:
https://github.com/apache/spark/pull/23000#discussion_r234819827
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
---
@@ -410,6 +410,30 @@ class DateTimeUtilsSuite
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/23053
I agree with @mccheah, `-p skip` seems odd. It seems cleaner to only
include i.e. `-p` flag when we desire python support.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23072
**[Test build #99028 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99028/testReport)**
for PR 23072 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17654
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15591
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17673
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17631
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23054
sorry it conflicts, can you resolve it? I think it's ready to go
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23062
**[Test build #99033 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99033/testReport)**
for PR 23062 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23062
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99033/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23062
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23054
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23054
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23054
**[Test build #99035 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99035/testReport)**
for PR 23054 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/23086#discussion_r234855810
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/Batch.java ---
@@ -0,0 +1,47 @@
+/*
+ * Licensed to the Apache Software
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22237#discussion_r234789275
--- Diff: R/pkg/tests/fulltests/test_sparkSQL.R ---
@@ -1694,7 +1694,7 @@ test_that("column functions", {
df <- as.DataFrame(list(list("col" =
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23081
**[Test build #98998 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98998/testReport)**
for PR 23081 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23054
**[Test build #99009 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99009/testReport)**
for PR 23054 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23057
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99008/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23027
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99007/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23057
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23027
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/23090#discussion_r234799817
--- Diff: docs/configuration.md ---
@@ -973,6 +973,14 @@ Apart from these, the following properties are also
available, and may be useful
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23054
**[Test build #99010 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99010/testReport)**
for PR 23054 at commit
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/23038
It is a random failure. Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user rezasafi commented on a diff in the pull request:
https://github.com/apache/spark/pull/22612#discussion_r234815376
--- Diff:
core/src/main/scala/org/apache/spark/executor/ProcfsBasedSystems.scala ---
@@ -0,0 +1,228 @@
+/*
+ * Licensed to the Apache Software
Github user Tagar commented on the issue:
https://github.com/apache/spark/pull/22635
Thank you @viirya
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23039
**[Test build #99030 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99030/testReport)**
for PR 23039 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23090
**[Test build #99019 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99019/testReport)**
for PR 23090 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23039
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23062
**[Test build #99029 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99029/testReport)**
for PR 23062 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23039
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17586
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17586
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17654
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/23053
My understanding is that K8s is still marked as experimental, and something
like this can be changed with the expectation that we're hardening in 3.0. If
anything, we should be making this breaking
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23062
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23087
**[Test build #99032 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99032/testReport)**
for PR 23087 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23087
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/23069
Yeah, or at least so claims Scala 2.12. Java evidently doesn't object.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23062
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23062
**[Test build #99039 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99039/testReport)**
for PR 23062 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23062
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23072
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23072
**[Test build #99017 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99017/testReport)**
for PR 23072 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23072
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99017/
Test FAILed.
---
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/23091
@HyukjinKwon Please, take a look at the PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23091
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23054
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23054
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99009/
Test PASSed.
---
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/23039
@gatorsmile @hvanhovell Could you look at the PR, please. I extracted a
piece of changes from #22429.
---
-
To unsubscribe,
GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/23092
[SPARK-26094][CORE][STREAMING] createNonEcFile creates parent dirs.
## What changes were proposed in this pull request?
We explicitly avoid files with hdfs erasure coding for the streaming
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23037
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23037
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5154/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23037
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user ramaddepally commented on the issue:
https://github.com/apache/spark/pull/23053
> Hm, reviewing this again I think a better way to do it is to only opt-in
to building images of different bindings. So for example the Python image
should only be built when `-p ` is
Github user drewrobb commented on a diff in the pull request:
https://github.com/apache/spark/pull/23062#discussion_r234828613
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ObjectExpressionsSuite.scala
---
@@ -410,6 +410,16 @@ class
Github user drewrobb commented on a diff in the pull request:
https://github.com/apache/spark/pull/23062#discussion_r234828661
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
---
@@ -788,12 +788,37 @@ object ScalaReflection extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23088
**[Test build #99016 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99016/testReport)**
for PR 23088 at commit
Github user drewrobb commented on a diff in the pull request:
https://github.com/apache/spark/pull/23062#discussion_r234828814
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
---
@@ -788,12 +788,37 @@ object ScalaReflection extends
Github user drewrobb commented on a diff in the pull request:
https://github.com/apache/spark/pull/23062#discussion_r234828642
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
---
@@ -788,12 +788,37 @@ object ScalaReflection extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23091
**[Test build #99021 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99021/testReport)**
for PR 23091 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23079
thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22305
**[Test build #99022 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99022/testReport)**
for PR 22305 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23087
**[Test build #99034 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99034/testReport)**
for PR 23087 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23087
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23092
**[Test build #99027 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99027/testReport)**
for PR 23092 at commit
1 - 100 of 486 matches
Mail list logo