[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20930 **[Test build #89849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89849/testReport)** for PR 20930 at commit [`a201764`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #89852 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89852/testReport)** for PR 21155 at commit [`0b4d868`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21155 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21155 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89854/ Test FAILed. ---

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #89854 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89854/testReport)** for PR 21155 at commit [`88fde1c`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21121: [SPARK-24042][SQL] Collection function: zip_with_index

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21121 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89857/ Test FAILed. ---

[GitHub] spark issue #21121: [SPARK-24042][SQL] Collection function: zip_with_index

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21121 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21121: [SPARK-24042][SQL] Collection function: zip_with_index

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21121 **[Test build #89857 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89857/testReport)** for PR 21121 at commit [`fd71544`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89853/ Test FAILed. ---

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #89853 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89853/testReport)** for PR 20933 at commit [`2190d9d`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10.0.

2018-04-25 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/21070 The fix for PARQUET-686 was to suppress min/max stats. It is safe to push filters, but those filters can't be used without the stats. 1.10.0 has the correct stats and can use those filters. --- --

[GitHub] spark pull request #21126: [SPARK-24050][SS] Calculate input / processing ra...

2018-04-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21126 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21052: [SPARK-23799][SQL] FilterEstimation.evaluateInSet produc...

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21052 See my PR https://github.com/apache/spark/pull/21147. We need to fix the issue first. --- - To unsubscribe, e-mail: reviews-u

[GitHub] spark issue #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10.0.

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21070 Regarding [`SPARK-17213`](https://issues.apache.org/jira/browse/SPARK-17213), we already enable the pushdown after we upgrading to 1.8.2. Is my understanding right? --- ---

[GitHub] spark issue #21145: [SPARK-24073][SQL]: Rename DataReaderFactory to ReadTask...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21145 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89848/ Test PASSed. ---

[GitHub] spark issue #21145: [SPARK-24073][SQL]: Rename DataReaderFactory to ReadTask...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21145 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21145: [SPARK-24073][SQL]: Rename DataReaderFactory to ReadTask...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21145 **[Test build #89848 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89848/testReport)** for PR 21145 at commit [`609ec14`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #21156: [WIP][SPARK-24087][SQL] Avoid shuffle when join keys are...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21156 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21156: [WIP][SPARK-24087][SQL] Avoid shuffle when join keys are...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21156 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89847/ Test PASSed. ---

[GitHub] spark issue #21156: [WIP][SPARK-24087][SQL] Avoid shuffle when join keys are...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21156 **[Test build #89847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89847/testReport)** for PR 21156 at commit [`27df568`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10....

2018-04-25 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/21070#discussion_r184156731 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala --- @@ -503,7 +503,7 @@ class InMemoryColumnarQue

[GitHub] spark issue #21138: [SPARK-24062][Thrift Server] Fix SASL encryption cannot ...

2018-04-25 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21138 I'm fine with the fix. Not familiar with the internals of the STS / Hive to suggest anything different. --- - To unsubscribe, e-m

[GitHub] spark pull request #21158: [SPARK-23850][sql] Add separate config for SQL op...

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21158#discussion_r184152897 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala --- @@ -225,7 +225,7 @@ class QueryExecution(val sparkSession: Spar

[GitHub] spark pull request #21158: [SPARK-23850][sql] Add separate config for SQL op...

2018-04-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/21158#discussion_r184152311 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -342,7 +342,7 @@ package object config { "a property key or

[GitHub] spark pull request #21158: [SPARK-23850][sql] Add separate config for SQL op...

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21158#discussion_r184151995 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -342,7 +342,7 @@ package object config { "a property key

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2679/ Tes

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21158 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21121: [SPARK-24042][SQL] Collection function: zip_with_index

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21121 **[Test build #89857 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89857/testReport)** for PR 21121 at commit [`fd71544`](https://github.com/apache/spark/commit/fd

[GitHub] spark issue #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10.0.

2018-04-25 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/21070 There are two main reasons to update. First, the problem behind SPARK-17213 is fixed, hence the new min and max fields. Second, this updates the internal byte array management, which is needed for pa

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21158 **[Test build #89855 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89855/testReport)** for PR 21158 at commit [`deb299b`](https://github.com/apache/spark/commit/de

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21066 **[Test build #89856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89856/testReport)** for PR 21066 at commit [`659a7a4`](https://github.com/apache/spark/commit/65

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21066 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2678/ Tes

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21066 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21066 Hi, @mridulm . Could you review this PR please? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For addi

[GitHub] spark pull request #21158: [SPARK-23850][sql] Add separate config for SQL op...

2018-04-25 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/21158 [SPARK-23850][sql] Add separate config for SQL options redaction. The old code was relying on a core configuration and extended its default value to include things that redact desired things in t

[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20146 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89845/ Test FAILed. ---

[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20146 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20146 **[Test build #89845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89845/testReport)** for PR 20146 at commit [`c168522`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21066 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: rev

[GitHub] spark pull request #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10....

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21070#discussion_r184144930 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala --- @@ -503,7 +503,7 @@ class InMemoryColumna

[GitHub] spark pull request #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10....

2018-04-25 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/21070#discussion_r184139736 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala --- @@ -503,7 +503,7 @@ class InMemoryColumnarQue

[GitHub] spark issue #19222: [SPARK-10399][SPARK-23879][CORE][SQL] Introduce multiple...

2018-04-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19222 @rxin @cloud-fan I am very sorry for preparing performance data since I was busy these weeks. I confirmed that `MemoryBlock` approach is faster for OnHeap and is equal to for OffHeap compared to

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #89854 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89854/testReport)** for PR 21155 at commit [`88fde1c`](https://github.com/apache/spark/commit/88

[GitHub] spark issue #21052: [SPARK-23799][SQL] FilterEstimation.evaluateInSet produc...

2018-04-25 Thread mshtelma
Github user mshtelma commented on the issue: https://github.com/apache/spark/pull/21052 @gatorsmile should I create new PR with these changes for 2.3 branch ? I will do this. Do we need new jira for 2.3 ? or should I reference the existing one ? --- -

[GitHub] spark pull request #20946: [SPARK-23565] [SS] New error message for structur...

2018-04-25 Thread patrickmcgloin
Github user patrickmcgloin closed the pull request at: https://github.com/apache/spark/pull/20946 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache

[GitHub] spark pull request #20946: [SPARK-23565] [SS] New error message for structur...

2018-04-25 Thread patrickmcgloin
GitHub user patrickmcgloin reopened a pull request: https://github.com/apache/spark/pull/20946 [SPARK-23565] [SS] New error message for structured streaming sources assertion ## What changes were proposed in this pull request? A more informative message to tell you why a st

[GitHub] spark issue #20946: [SPARK-23565] [SS] New error message for structured stre...

2018-04-25 Thread patrickmcgloin
Github user patrickmcgloin commented on the issue: https://github.com/apache/spark/pull/20946 Hi @xuanyuanking, please see comments above. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additi

[GitHub] spark issue #20946: [SPARK-23565] [SS] New error message for structured stre...

2018-04-25 Thread patrickmcgloin
Github user patrickmcgloin commented on the issue: https://github.com/apache/spark/pull/20946 Hi Xuan, I have updated the title, removed the extra white space after the period / dot and removed the UT. --- ---

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2677/ Tes

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #89853 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89853/testReport)** for PR 20933 at commit [`2190d9d`](https://github.com/apache/spark/commit/21

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #89852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89852/testReport)** for PR 21155 at commit [`0b4d868`](https://github.com/apache/spark/commit/0b

[GitHub] spark pull request #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread wajda
Github user wajda commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r184130293 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1059,3 +1063,282 @@ case class Flatten(chi

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89846/ Test FAILed. ---

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #89846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89846/testReport)** for PR 20933 at commit [`36c5c7f`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21155#discussion_r184125363 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1059,3 +1063,282 @@ case class Flatten(chi

[GitHub] spark pull request #21152: [SPARK-23688][SS] Refactor tests away from rate s...

2018-04-25 Thread jose-torres
Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/21152#discussion_r184121867 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/continuous/ContinuousSuite.scala --- @@ -66,157 +66,115 @@ class ContinuousSuite exten

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21155 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #89851 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89851/testReport)** for PR 21155 at commit [`8fb427c`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21155 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89851/ Test FAILed. ---

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21155 **[Test build #89851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89851/testReport)** for PR 21155 at commit [`8fb427c`](https://github.com/apache/spark/commit/8f

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21155 cc @ueshin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@s

[GitHub] spark issue #21155: SPARK-23927: Add "sequence" expression

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21155 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@sp

[GitHub] spark issue #21119: [SPARK-19826][ML][PYTHON]add spark.ml Python API for PIC

2018-04-25 Thread huaxingao
Github user huaxingao commented on the issue: https://github.com/apache/spark/pull/21119 @jkbradley Could you please review when you have time? Thank you very much in advance! --- - To unsubscribe, e-mail: reviews-u

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21066 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89844/ Test FAILed. ---

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21066 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21066: [SPARK-23977][CLOUD][WIP] Add commit protocol binding to...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21066 **[Test build #89844 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89844/testReport)** for PR 21066 at commit [`659a7a4`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10....

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21070#discussion_r184116235 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala --- @@ -503,7 +503,7 @@ class InMemoryColumna

[GitHub] spark issue #21070: [SPARK-23972][BUILD][SQL] Update Parquet to 1.10.0.

2018-04-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21070 Parquet is the default file format. Thus, the impact could be huge. We need to be more cautious. Since Parquet 1.10 was officially released this month. Thus, we might need more careful review for

[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2676/ Tes

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-04-25 Thread pwoody
Github user pwoody commented on the issue: https://github.com/apache/spark/pull/20915 @gatorsmile any chance you could take a look at this? Let me know if there is someone more appropriate to review, thanks! --- - T

[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20930 **[Test build #89850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89850/testReport)** for PR 20930 at commit [`7f8503f`](https://github.com/apache/spark/commit/7f

[GitHub] spark pull request #20930: [SPARK-23811][Core] FetchFailed comes before Succ...

2018-04-25 Thread xuanyuanking
Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/20930#discussion_r184109204 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1266,6 +1266,9 @@ class DAGScheduler( }

[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2675/ Tes

[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20930 **[Test build #89849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89849/testReport)** for PR 20930 at commit [`a201764`](https://github.com/apache/spark/commit/a2

[GitHub] spark issue #21157: [SPARK-22674][PYTHON] Removed the namedtuple pickling pa...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21157 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21157: [SPARK-22674][PYTHON] Removed the namedtuple pickling pa...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21157 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21157: [SPARK-22674][PYTHON] Removed the namedtuple pick...

2018-04-25 Thread superbobry
GitHub user superbobry opened a pull request: https://github.com/apache/spark/pull/21157 [SPARK-22674][PYTHON] Removed the namedtuple pickling patch ## What changes were proposed in this pull request? This is a breaking change. Prior to this commit PySpark patched `

[GitHub] spark issue #21145: [SPARK-24073][SQL]: Rename DataReaderFactory to ReadTask...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21145 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21145: [SPARK-24073][SQL]: Rename DataReaderFactory to ReadTask...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21145 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2674/ Tes

[GitHub] spark issue #21145: [SPARK-24073][SQL]: Rename DataReaderFactory to ReadTask...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21145 **[Test build #89848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89848/testReport)** for PR 21145 at commit [`609ec14`](https://github.com/apache/spark/commit/60

[GitHub] spark issue #21156: [SPARK-24087][SQL] Avoid shuffle when join keys are a su...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21156 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21156: [SPARK-24087][SQL] Avoid shuffle when join keys are a su...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21156 **[Test build #89847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89847/testReport)** for PR 21156 at commit [`27df568`](https://github.com/apache/spark/commit/27

[GitHub] spark pull request #21156: [SPARK-24087][SQL] Avoid shuffle when join keys a...

2018-04-25 Thread yucai
GitHub user yucai opened a pull request: https://github.com/apache/spark/pull/21156 [SPARK-24087][SQL] Avoid shuffle when join keys are a super-set of bucket keys ## What changes were proposed in this pull request? To improve the bucket join, when join keys are a super-set

[GitHub] spark issue #21106: [SPARK-23711][SQL][WIP] Add fallback logic for UnsafePro...

2018-04-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21106 I tried to unify this class with `UnsafeProjectionCreator`. So there is no more `UnsafeProjectionCreator` trait. Without the trait `UnsafeProjectionCreator`, one problem is we can't easily t

[GitHub] spark issue #21152: [SPARK-23688][SS] Refactor tests away from rate source

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21152 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89843/ Test PASSed. ---

[GitHub] spark issue #21152: [SPARK-23688][SS] Refactor tests away from rate source

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21152 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21152: [SPARK-23688][SS] Refactor tests away from rate source

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21152 **[Test build #89843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89843/testReport)** for PR 21152 at commit [`ec5c6e6`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #21154: [SPARK-24012][SQL][TEST][followup] add unit test

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21154 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89842/ Test PASSed. ---

[GitHub] spark issue #21154: [SPARK-24012][SQL][TEST][followup] add unit test

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21154 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21154: [SPARK-24012][SQL][TEST][followup] add unit test

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21154 **[Test build #89842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89842/testReport)** for PR 21154 at commit [`f1a0f4f`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #21068: [SPARK-16630][YARN] Blacklist a node if executors won't ...

2018-04-25 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/21068 A couple more high-level thoughts: 1) Do we want to have a event posted about the node getting blacklisted? I think it would be useful. But then there needs to be a msg from the YarnAlloca

[GitHub] spark pull request #21100: [SPARK-24012][SQL] Union of map and other compati...

2018-04-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21100#discussion_r184073128 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -112,6 +112,14 @@ object TypeCoercion {

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2673/ Tes

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #89846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89846/testReport)** for PR 20933 at commit [`36c5c7f`](https://github.com/apache/spark/commit/36

<    1   2   3   4   5   >