[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15627 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15627 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67649/ Test PASSed. ---

[GitHub] spark issue #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-27 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/15632 @davies that check looks wrong - behaviorally we might not be hitting it due to other preconditions enforced ; worrying to see this On Oct 26, 2016 10:18 AM, "Davies Liu"

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-27 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15612 @rxin Move into `rdd` package and add doc for `preservesPartitioner`. The code base have many other places using `preservesPartitioning` I don't update them for now, we can let other person to

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85364365 --- Diff: pom.xml --- @@ -26,6 +26,7 @@ org.apache.spark spark-parent_2.11 + --- End diff -- Something along the

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15627 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15627 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67648/ Test PASSed. ---

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15641 **[Test build #67652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67652/consoleFull)** for PR 15641 at commit

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15627 **[Test build #67648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67648/consoleFull)** for PR 15627 at commit

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85365186 --- Diff: python/README.md --- @@ -0,0 +1,32 @@ +# Apache Spark + +Spark is a fast and general cluster computing system for Big Data. It

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15641 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85364778 --- Diff: python/README.md --- @@ -0,0 +1,32 @@ +# Apache Spark + +Spark is a fast and general cluster computing system for Big Data. It

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67651/consoleFull)** for PR 15612 at commit

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15657 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15657 **[Test build #67650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67650/consoleFull)** for PR 15657 at commit

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15657 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 @nchammas thanks for taking the time to start reviewing this. I think the blogpost for this part of the feature would say something along the lines of "More easily install & manage PySpark with

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85361946 --- Diff: bin/spark-class --- @@ -36,7 +36,7 @@ else fi # Find Spark jars. -if [ -f "${SPARK_HOME}/RELEASE" ]; then +if [ -d

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85361694 --- Diff: dev/create-release/release-build.sh --- @@ -162,14 +162,35 @@ if [[ "$1" == "package" ]]; then export ZINC_PORT=$ZINC_PORT echo

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85361542 --- Diff: python/MANIFEST.in --- @@ -0,0 +1,23 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15627 **[Test build #67649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67649/consoleFull)** for PR 15627 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67643/ Test FAILed. ---

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85360766 --- Diff: python/README.md --- @@ -0,0 +1,32 @@ +# Apache Spark + +Spark is a fast and general cluster computing system for Big Data. It

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85360572 --- Diff: python/README.md --- @@ -0,0 +1,32 @@ +# Apache Spark + +Spark is a fast and general cluster computing system for Big Data. It

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15627 **[Test build #67648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67648/consoleFull)** for PR 15627 at commit

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15627 Jenkins, add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-27 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15627 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85359033 --- Diff: python/setup.py --- @@ -0,0 +1,169 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85355701 --- Diff: python/setup.py --- @@ -0,0 +1,169 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85352748 --- Diff: pom.xml --- @@ -26,6 +26,7 @@ org.apache.spark spark-parent_2.11 + --- End diff -- Would it be overkill

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85354868 --- Diff: python/README.md --- @@ -0,0 +1,32 @@ +# Apache Spark + +Spark is a fast and general cluster computing system for Big Data. It

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67644/ Test FAILed. ---

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85355211 --- Diff: python/pyspark/find_spark_home.py --- @@ -0,0 +1,65 @@ +#!/usr/bin/python + +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85355847 --- Diff: python/setup.cfg --- @@ -0,0 +1,22 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85350993 --- Diff: bin/spark-class --- @@ -36,7 +36,7 @@ else fi # Find Spark jars. -if [ -f "${SPARK_HOME}/RELEASE" ]; then +if [ -d

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85353057 --- Diff: python/MANIFEST.in --- @@ -0,0 +1,23 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85353699 --- Diff: python/README.md --- @@ -0,0 +1,32 @@ +# Apache Spark + +Spark is a fast and general cluster computing system for Big Data. It

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85351820 --- Diff: dev/create-release/release-build.sh --- @@ -162,14 +162,35 @@ if [[ "$1" == "package" ]]; then export ZINC_PORT=$ZINC_PORT echo

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15658: [SPARK-13770] [Documentation][ML] Document the ML...

2016-10-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15658#discussion_r85357265 --- Diff: docs/ml-features.md --- @@ -729,6 +729,61 @@ for more details on the API. +## Interaction + +`Interaction` is a

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15354 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67646/consoleFull)** for PR 15513 at commit

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85354084 --- Diff: docs/ml-features.md --- @@ -1333,14 +1333,14 @@ for more details on the API. `ChiSqSelector` stands for Chi-Squared feature selection. It

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85354615 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/ChiSqSelector.scala --- @@ -44,67 +44,78 @@ private[feature] trait ChiSqSelectorParams extends

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15657 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15657 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67642/ Test PASSed. ---

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15657 **[Test build #67642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67642/consoleFull)** for PR 15657 at commit

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15354 **[Test build #67647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67647/consoleFull)** for PR 15354 at commit

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15354 It seems the test is not related with this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15527 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15513 I took another look and It seems generally fine. Could you take a look all? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15527 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67645/ Test PASSed. ---

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15527 **[Test build #67645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67645/consoleFull)** for PR 15527 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67641/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67641/ Test FAILed. ---

[GitHub] spark issue #15652: [SPARK-16987] [None] Add spark-default.conf property to ...

2016-10-27 Thread hayashidac
Github user hayashidac commented on the issue: https://github.com/apache/spark/pull/15652 Thank you very much. I fixed for your comment. Please check again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15527: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15527 **[Test build #67645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67645/consoleFull)** for PR 15527 at commit

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #3376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3376/consoleFull)** for PR 15513 at commit

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-10-27 Thread hayashidac
Github user hayashidac commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r85343659 --- Diff: docs/configuration.md --- @@ -1664,6 +1664,15 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-10-27 Thread hayashidac
Github user hayashidac commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r85343771 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -308,14 +308,22 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15655 **[Test build #3375 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3375/consoleFull)** for PR 15655 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67644/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67643/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67640/ Test FAILed. ---

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67640/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15657 **[Test build #67642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67642/consoleFull)** for PR 15657 at commit

[GitHub] spark issue #15657: [DO NOT MERGE] Test partition

2016-10-27 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15657 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67641/consoleFull)** for PR 15659 at commit

[GitHub] spark pull request #15658: [SPARK-13770] [Documentation][ML] Document the ML...

2016-10-27 Thread hayashidac
Github user hayashidac commented on a diff in the pull request: https://github.com/apache/spark/pull/15658#discussion_r85326729 --- Diff: docs/ml-features.md --- @@ -729,6 +729,28 @@ for more details on the API. +## Interaction + +`Implements` is a

[GitHub] spark pull request #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to b...

2016-10-27 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r85326497 --- Diff: python/setup.py --- @@ -0,0 +1,169 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15641 Seems many test builds failed in `org.apache.spark.sql.streaming.StreamingQuerySuite.StreamExecution metadata garbage collection`. Do you know why? @srowen --- If your project is set up for it,

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15641 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67639/ Test FAILed. ---

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15641 **[Test build #67639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67639/consoleFull)** for PR 15641 at commit

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15641 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #3376 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3376/consoleFull)** for PR 15513 at commit

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15655 **[Test build #3375 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3375/consoleFull)** for PR 15655 at commit

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15655 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67638/ Test FAILed. ---

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15655 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15655 **[Test build #67638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67638/consoleFull)** for PR 15655 at commit

[GitHub] spark issue #15655: [SPARK-18010][CORE] Reduce work performed for building u...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15655 **[Test build #3374 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3374/consoleFull)** for PR 15655 at commit

[GitHub] spark issue #15659: [WIP][SPARK-1267][SPARK-18129] Allow PySpark to be pip i...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67640/consoleFull)** for PR 15659 at commit

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85311930 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -171,18 +171,19 @@ object ChiSqSelectorModel extends

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15641 **[Test build #67639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67639/consoleFull)** for PR 15641 at commit

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85311619 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/ChiSqSelector.scala --- @@ -44,67 +44,78 @@ private[feature] trait ChiSqSelectorParams extends

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85311677 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/ChiSqSelector.scala --- @@ -44,67 +44,78 @@ private[feature] trait ChiSqSelectorParams extends

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15641 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85310898 --- Diff: docs/mllib-feature-extraction.md --- @@ -227,22 +227,19 @@ both speed and statistical learning behavior.

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85310797 --- Diff: docs/ml-features.md --- @@ -1333,14 +1333,14 @@ for more details on the API. `ChiSqSelector` stands for Chi-Squared feature selection. It

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85310862 --- Diff: docs/mllib-feature-extraction.md --- @@ -227,22 +227,19 @@ both speed and statistical learning behavior.

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-27 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/15647#discussion_r85310501 --- Diff: docs/ml-features.md --- @@ -1333,14 +1333,14 @@ for more details on the API. `ChiSqSelector` stands for Chi-Squared feature selection. It

[GitHub] spark issue #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls in cat...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15417 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67636/ Test FAILed. ---

[GitHub] spark issue #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls in cat...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15417 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15417: [SPARK-17851][SQL][TESTS] Make sure all test sqls in cat...

2016-10-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15417 **[Test build #67636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67636/consoleFull)** for PR 15417 at commit

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-10-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r85307391 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -308,14 +308,22 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-10-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r85306933 --- Diff: core/src/main/scala/org/apache/spark/ui/WebUI.scala --- @@ -147,7 +147,10 @@ private[spark] abstract class WebUI( } /** Return

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-10-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r85307232 --- Diff: docs/configuration.md --- @@ -1664,6 +1664,15 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15641 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67634/ Test FAILed. ---

<    1   2   3   4   5   >