[GitHub] spark pull request #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream ...

2017-05-24 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/17343#discussion_r118428707 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java --- @@ -321,11 +334,14 @@ void forceSorterToSpill() throws IOExcep

[GitHub] spark pull request #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream ...

2017-05-24 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/17343#discussion_r118428101 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java --- @@ -22,6 +22,7 @@ import java.nio.channels.FileChannel;

[GitHub] spark pull request #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream ...

2017-05-24 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/17343#discussion_r118428639 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java --- @@ -339,23 +355,26 @@ void forceSorterToSpill() throws IOExcep

[GitHub] spark pull request #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream ...

2017-05-24 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/17343#discussion_r118428258 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java --- @@ -98,6 +99,18 @@ */ private boolean stopping

[GitHub] spark pull request #17343: [SPARK-20014] Optimize mergeSpillsWithFileStream ...

2017-05-24 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/17343#discussion_r118429093 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java --- @@ -339,23 +355,26 @@ void forceSorterToSpill() throws IOExcep

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17113 **[Test build #77344 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77344/testReport)** for PR 17113 at commit [`44c7108`](https://github.com/apache/spark/commit/44

[GitHub] spark issue #18079: [SPARK-20841][SQL] Support column aliases for catalog ta...

2017-05-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18079 It sounds like PostgresSQL supports it. See the docs in https://www.postgresql.org/docs/9.2/static/sql-select.html Actually, we also need to support the other alias in the from clauses:

[GitHub] spark issue #17181: [SPARK-19824][Core] Standalone master JSON not showing c...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17181 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17181: [SPARK-19824][Core] Standalone master JSON not showing c...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17181 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77335/ Test FAILed. ---

[GitHub] spark issue #17181: [SPARK-19824][Core] Standalone master JSON not showing c...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17181 **[Test build #77335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77335/testReport)** for PR 17181 at commit [`f8b5eaf`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77332/ Test PASSed. ---

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77332/testReport)** for PR 17770 at commit [`8314cc3`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77331/ Test PASSed. ---

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77331/testReport)** for PR 17770 at commit [`b82b018`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18025 **[Test build #77343 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77343/testReport)** for PR 18025 at commit [`21e54c0`](https://github.com/apache/spark/commit/21

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18057 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18057 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77333/ Test PASSed. ---

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18057 **[Test build #77333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77333/testReport)** for PR 18057 at commit [`4c68688`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18090: [SPARK-20250][Core]Improper OOM error when a task been k...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18090: [SPARK-20250][Core]Improper OOM error when a task been k...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77329/ Test PASSed. ---

[GitHub] spark issue #18090: [SPARK-20250][Core]Improper OOM error when a task been k...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18090 **[Test build #77329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77329/testReport)** for PR 18090 at commit [`1a45ff5`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18025 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77341/ Test FAILed. ---

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18025 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18025 **[Test build #77341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77341/testReport)** for PR 18025 at commit [`038eac3`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16578 **[Test build #77342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77342/testReport)** for PR 16578 at commit [`464b18d`](https://github.com/apache/spark/commit/46

[GitHub] spark pull request #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTre...

2017-05-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18067#discussion_r118425359 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -776,6 +778,20 @@ newDF <- createDataFrame(data.frame(x = c(1.5, 3.2))) head(predict(isoregMod

[GitHub] spark pull request #18084: [SPARK-19900][core]Remove driver when relaunching...

2017-05-24 Thread liyichao
Github user liyichao commented on a diff in the pull request: https://github.com/apache/spark/pull/18084#discussion_r118424700 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -796,9 +796,12 @@ private[deploy] class Master( } priv

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-24 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r118424375 --- Diff: core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala --- @@ -401,4 +411,61 @@ class ShuffleBlockFetcherIteratorS

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-24 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r118424377 --- Diff: docs/configuration.md --- @@ -520,6 +520,14 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTre...

2017-05-24 Thread zhengruifeng
Github user zhengruifeng commented on a diff in the pull request: https://github.com/apache/spark/pull/18067#discussion_r118423872 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -776,6 +778,20 @@ newDF <- createDataFrame(data.frame(x = c(1.5, 3.2))) head(predict(isoregMo

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-24 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16578 Sorry about test failures. Will fix tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18025 @felixcheung All comments are addressed now and I think this is ready for review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18025 - New commit now resolves the Name issue. `@title` does not work, which is the header in the second line `\title{Aggregate functions for Column operations}`. The solution is to use `@name NULL`

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18025 **[Test build #77341 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77341/testReport)** for PR 18025 at commit [`038eac3`](https://github.com/apache/spark/commit/03

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77339/ Test PASSed. ---

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77339 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77339/testReport)** for PR 18104 at commit [`a72ab8c`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #18097: [Spark-20873][SQL] Improve the error message for ...

2017-05-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18097#discussion_r118421574 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/ColumnType.scala --- @@ -684,7 +684,7 @@ private[columnar] object ColumnType {

[GitHub] spark pull request #18094: [Spark-20775][SQL] Added scala support from_json

2017-05-24 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18094#discussion_r118421269 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -3072,6 +3072,22 @@ object functions { * @since 2.1.0 */

[GitHub] spark pull request #18094: [Spark-20775][SQL] Added scala support from_json

2017-05-24 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18094#discussion_r118421254 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -3060,7 +3060,7 @@ object functions { from_json(e, schema, Map.empty[St

[GitHub] spark pull request #18097: [Spark-20873][SQL] Improve the error message for ...

2017-05-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18097#discussion_r118421460 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/ColumnTypeSuite.scala --- @@ -144,4 +144,18 @@ class ColumnTypeSuite extends S

[GitHub] spark issue #18097: [Spark-20873][SQL] Improve the error message for unsuppo...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18097 **[Test build #77340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77340/testReport)** for PR 18097 at commit [`f53de3e`](https://github.com/apache/spark/commit/f5

[GitHub] spark issue #18097: [Spark-20873][SQL] Improve the error message for unsuppo...

2017-05-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18097 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #13067: [SPARK-4131] [SQL] Support INSERT OVERWRITE [LOCAL] DIRE...

2017-05-24 Thread santhavathi
Github user santhavathi commented on the issue: https://github.com/apache/spark/pull/13067 Is this feature available yet? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13067: [SPARK-4131] [SQL] Support INSERT OVERWRITE [LOCAL] DIRE...

2017-05-24 Thread santhavathi
Github user santhavathi commented on the issue: https://github.com/apache/spark/pull/13067 Is this feature available yet? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77339/testReport)** for PR 18104 at commit [`a72ab8c`](https://github.com/apache/spark/commit/a7

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18091 **[Test build #77338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77338/testReport)** for PR 18091 at commit [`c79de07`](https://github.com/apache/spark/commit/c7

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77337 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77337/testReport)** for PR 18064 at commit [`eec0946`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77337/ Test FAILed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-24 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18091 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77337/testReport)** for PR 18064 at commit [`eec0946`](https://github.com/apache/spark/commit/ee

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77336/ Test FAILed. ---

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77336 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77336/testReport)** for PR 18104 at commit [`313dcbc`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77336/testReport)** for PR 18104 at commit [`313dcbc`](https://github.com/apache/spark/commit/31

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18058 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18058 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77334/ Test PASSed. ---

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18058 **[Test build #77334 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77334/testReport)** for PR 18058 at commit [`44267cb`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added if joi...

2017-05-24 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/16985 @cloud-fan : ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #17181: [SPARK-19824][Core] Standalone master JSON not showing c...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17181 **[Test build #77335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77335/testReport)** for PR 17181 at commit [`f8b5eaf`](https://github.com/apache/spark/commit/f8

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77328/ Test FAILed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77328/testReport)** for PR 18064 at commit [`57f9dde`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17181: [SPARK-19824][Core] Standalone master JSON not showing c...

2017-05-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17181 Could you please check whether there exists any other inconsistent value between the UI and JSON API? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #12252: [SPARK-14460] [SQL] properly handling of column name con...

2017-05-24 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/12252 seems it's fixed in https://github.com/apache/spark/pull/15662 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark issue #17181: [SPARK-19824][Core] Standalone master JSON not showing c...

2017-05-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17181 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18025 re: title, would explicitly adding `@title` help? re: multiple class - agreed, a link or `@seealso` should be good. wouldn't `?coalesce` show the overloads though --- If your project is set

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18104 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77330/ Test PASSed. ---

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77330 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77330/testReport)** for PR 18104 at commit [`dab72a6`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-24 Thread facaiy
Github user facaiy commented on the issue: https://github.com/apache/spark/pull/18058 Hi, I'm not familiar with pyspark. I just wonder whether is it needed to create a unit test for verification. If yes, how to check it? Thanks. --- If your project is set up for it, you can reply to

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18058 **[Test build #77334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77334/testReport)** for PR 18058 at commit [`44267cb`](https://github.com/apache/spark/commit/44

[GitHub] spark pull request #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (...

2017-05-24 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/18058#discussion_r118416434 --- Diff: python/pyspark/ml/fpm.py --- @@ -49,6 +49,32 @@ def getMinSupport(self): return self.getOrDefault(self.minSupport) +cla

[GitHub] spark pull request #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (...

2017-05-24 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/18058#discussion_r118416400 --- Diff: python/pyspark/ml/fpm.py --- @@ -49,6 +49,32 @@ def getMinSupport(self): return self.getOrDefault(self.minSupport) +cla

[GitHub] spark pull request #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (...

2017-05-24 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/18058#discussion_r118416391 --- Diff: python/pyspark/ml/fpm.py --- @@ -49,6 +49,32 @@ def getMinSupport(self): return self.getOrDefault(self.minSupport) +cla

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-24 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17967 yes I'd hold this for a day. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18057 **[Test build #77333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77333/testReport)** for PR 18057 at commit [`4c68688`](https://github.com/apache/spark/commit/4c

[GitHub] spark issue #18090: [SPARK-20250][Core]Improper OOM error when a task been k...

2017-05-24 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18090 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77332/testReport)** for PR 17770 at commit [`8314cc3`](https://github.com/apache/spark/commit/83

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17770 **[Test build #77331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77331/testReport)** for PR 17770 at commit [`b82b018`](https://github.com/apache/spark/commit/b8

[GitHub] spark issue #18025: [WIP][SparkR] Grouped documentation for sql functions

2017-05-24 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18025 @felixcheung - The links to `stddev_samp` etc are already removed in the latest commit. - About collecting all the example into one, I think that'll work for this particular one. But I

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18091 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77323/ Test FAILed. ---

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18091 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18057 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77327/ Test FAILed. ---

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18091 **[Test build #77323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77323/testReport)** for PR 18091 at commit [`c79de07`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18057 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18057: [SPARK-20786][SQL][Backport-2.2]Improve ceil and floor h...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18057 **[Test build #77327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77327/testReport)** for PR 18057 at commit [`eaf236a`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17972: [SPARK-20723][ML]Add intermediate storage level to tree ...

2017-05-24 Thread phatak-dev
Github user phatak-dev commented on the issue: https://github.com/apache/spark/pull/17972 @MLnick can you start a jenkins build? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18104 **[Test build #77330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77330/testReport)** for PR 18104 at commit [`dab72a6`](https://github.com/apache/spark/commit/da

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-24 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17967 @felixcheung @yanboliang I'm fine with either the ascii table or the html table. It's your call. Hope to get over this minor doc issue and get this PR in soon. I can update the doc later i

[GitHub] spark pull request #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test...

2017-05-24 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/18104 [SPARK-20877][SPARKR][WIP] add timestamps to test runs ## What changes were proposed in this pull request? to investigate how long they run ## How was this patch tested?

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16578 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18079: [SPARK-20841][SQL] Support column aliases for catalog ta...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77322/ Test PASSed. ---

[GitHub] spark issue #18079: [SPARK-20841][SQL] Support column aliases for catalog ta...

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16578 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77326/ Test FAILed. ---

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16578 **[Test build #77326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77326/testReport)** for PR 16578 at commit [`9f2f340`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18079: [SPARK-20841][SQL] Support column aliases for catalog ta...

2017-05-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18079 **[Test build #77322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77322/testReport)** for PR 18079 at commit [`b0e5805`](https://github.com/apache/spark/commit/b

  1   2   3   4   5   6   >