[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15743 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15743 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68082/ Test FAILed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #68091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68091/consoleFull)** for PR 13065 at commit [`7b7fa6e`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-11-03 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r86461055 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -42,18 +60,43 @@ private[spark] case class AccumulatorMetadata( * `OUT` s

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15743 **[Test build #68082 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68082/consoleFull)** for PR 15743 at commit [`f8aee5d`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-11-03 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r86460868 --- Diff: core/src/main/scala/org/apache/spark/rdd/ShuffledRDD.scala --- @@ -104,10 +105,26 @@ class ShuffledRDD[K: ClassTag, V: ClassTag, C: ClassTag](

[GitHub] spark issue #15760: [SPARK-18259][SQL]Do not capture Throwable in QueryExecu...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15760 **[Test build #68090 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68090/consoleFull)** for PR 15760 at commit [`d76c37e`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15760: [SPARK-18259][SQL]Do not capture Throwable in QueryExecu...

2016-11-03 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15760 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-11-03 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r86460332 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -306,18 +428,19 @@ class LongAccumulator extends AccumulatorV2[jl.Long, jl.Lon

[GitHub] spark issue #15760: [SPARK-18259][SQL]Do not capture Throwable in QueryExecu...

2016-11-03 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15760 cc @srinathshankar @sameeragarwal --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request #15760: [SPARK-18259][SQL]Do not capture Throwable in Que...

2016-11-03 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/15760 [SPARK-18259][SQL]Do not capture Throwable in QueryExecution ## What changes were proposed in this pull request? `QueryExecution.toString` currently captures `java.lang.Throwable`s; this is

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

2016-11-03 Thread jnadler
Github user jnadler commented on the issue: https://github.com/apache/spark/pull/15132 Testing has gone well. It's clearly successful in applying separate maxrates to our 2 topics. Works as expected with backpressure enabled; backpressure throttles both streams proportionally, no

[GitHub] spark pull request #15757: [SPARK-18257][SS] Improve error reporting for Fil...

2016-11-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15757 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15757: [SPARK-18257][SS] Improve error reporting for FileStress...

2016-11-03 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15757 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark pull request #15697: [SparkR][Test]:remove unnecessary suppressWarning...

2016-11-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15697 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15758: [MINOR] Remove calculation of bucket spec when not expec...

2016-11-03 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15758 ah you meant the assert in save itself. I don't think we should remove it, since it is largely noop and might be useful once we allow bucket in save... --- If your project is set up for it,

[GitHub] spark issue #15759: [SPARK-18210][ML] Pipeline.copy does not create an insta...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15759 **[Test build #3412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3412/consoleFull)** for PR 15759 at commit [`8764e36`](https://github.com/apache/spark/commit

[GitHub] spark issue #15758: [MINOR] Remove calculation of bucket spec when not expec...

2016-11-03 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15758 where's the assert? ``` private def getBucketSpec: Option[BucketSpec] = { if (sortColumnNames.isDefined) { require(numBuckets.isDefined, "sortBy must be used to

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-03 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15697 merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #15363: [SPARK-17791][SQL] Join reordering using star schema det...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15363 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15363: [SPARK-17791][SQL] Join reordering using star schema det...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15363 **[Test build #68089 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68089/consoleFull)** for PR 15363 at commit [`c21de3e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15363: [SPARK-17791][SQL] Join reordering using star schema det...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15363 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68089/ Test FAILed. ---

[GitHub] spark issue #15758: [MINOR] Remove calculation of bucket spec when not expec...

2016-11-03 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/15758 Thanks @rxin for looking into it. While reviewing that code I noticed the call and thought I'd push it for review here since...`getBucketSpec` is superfluous given `assertNotBucketed("save")`

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68088/ Test FAILed. ---

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #68088 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68088/consoleFull)** for PR 14426 at commit [`539782d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15757: [SPARK-18257][SS] Improve error reporting for FileStress...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15757 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15757: [SPARK-18257][SS] Improve error reporting for FileStress...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15757 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68080/ Test PASSed. ---

[GitHub] spark issue #15757: [SPARK-18257][SS] Improve error reporting for FileStress...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15757 **[Test build #68080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68080/consoleFull)** for PR 15757 at commit [`e75f4a5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15754: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an init...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15754 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15754: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an init...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68078/ Test PASSed. ---

[GitHub] spark issue #15739: [SPARK-16808][Core] prepend base URI for links on main h...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15739 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68079/ Test PASSed. ---

[GitHub] spark issue #15739: [SPARK-16808][Core] prepend base URI for links on main h...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15739 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15754: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an init...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15754 **[Test build #68078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68078/consoleFull)** for PR 15754 at commit [`95ad783`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15326: [SPARK-17759] [CORE] Avoid adding duplicate schedulables

2016-11-03 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15326 Hi @kayousterhout and @markhamstra, This PR is ready for review if it is possible. All feedbacks are welcome and thanks in advance ;) --- If your project is set up for it, you can

[GitHub] spark issue #15739: [SPARK-16808][Core] prepend base URI for links on main h...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15739 **[Test build #68079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68079/consoleFull)** for PR 15739 at commit [`164a082`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15593: [SPARK-18060][ML] Avoid unnecessary computation for MLOR

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15593 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68084/ Test PASSed. ---

[GitHub] spark issue #15593: [SPARK-18060][ML] Avoid unnecessary computation for MLOR

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15593 **[Test build #68084 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68084/consoleFull)** for PR 15593 at commit [`210e1d3`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15593: [SPARK-18060][ML] Avoid unnecessary computation for MLOR

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15593 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15737: [SPARK-18212][SS][KAFKA] increase executor poll t...

2016-11-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15737 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-03 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15697 @felixcheung Any comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15737 Thanks, merging to master and 2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68087/ Test PASSed. ---

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15737 **[Test build #68087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68087/consoleFull)** for PR 15737 at commit [`3c9bd75`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68085/ Test PASSed. ---

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15737 **[Test build #68085 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68085/consoleFull)** for PR 15737 at commit [`0efd4e9`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15725: [SPARK-18167] Re-enable the non-flaky parts of SQLQueryS...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15725 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68076/ Test PASSed. ---

[GitHub] spark issue #15363: [SPARK-17791][SQL] Join reordering using star schema det...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15363 **[Test build #68089 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68089/consoleFull)** for PR 15363 at commit [`c21de3e`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #15725: [SPARK-18167] Re-enable the non-flaky parts of SQLQueryS...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15725 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15725: [SPARK-18167] Re-enable the non-flaky parts of SQLQueryS...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15725 **[Test build #68076 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68076/consoleFull)** for PR 15725 at commit [`b1e912b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15658: [SPARK-13770] [Documentation][ML] Document the ML featur...

2016-11-03 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15658 Yeah I see what you've done, but the example still doesn't suggest what the output is. I think it's OK if the example has to be run to show the output, but, I think the documentation needs to exhibit

[GitHub] spark pull request #15627: [SPARK-18099][YARN] Fail if same files added to d...

2016-11-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15627 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-11-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14426 Resolve the conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-11-03 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15627 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featu

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #68088 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68088/consoleFull)** for PR 14426 at commit [`539782d`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15652: [SPARK-16987] [None] Add spark-default.conf property to ...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15652 **[Test build #3409 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3409/consoleFull)** for PR 15652 at commit [`3964609`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15743 **[Test build #68086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68086/consoleFull)** for PR 15743 at commit [`4c867f1`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15737 **[Test build #68087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68087/consoleFull)** for PR 15737 at commit [`3c9bd75`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #12904: [SPARK-15125][SQL] Changing CSV data source mapping of e...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12904 **[Test build #3410 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3410/consoleFull)** for PR 12904 at commit [`c7aa4aa`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15627 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68083/ Test PASSed. ---

[GitHub] spark issue #15759: [SPARK-18210][ML] Pipeline.copy does not create an insta...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15759 **[Test build #3412 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3412/consoleFull)** for PR 15759 at commit [`8764e36`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15754: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an init...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15754 **[Test build #3411 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3411/consoleFull)** for PR 15754 at commit [`95ad783`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15627 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15627 **[Test build #68083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68083/consoleFull)** for PR 15627 at commit [`51eefa5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15733: [SPARK-18138][DOCS] Document that Java 7, Python 2.6, Sc...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15733 **[Test build #3408 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3408/consoleFull)** for PR 15733 at commit [`8ee3d80`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15700: [SPARK-17964][SparkR] Enable SparkR with Mesos client mo...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15700 **[Test build #3407 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3407/consoleFull)** for PR 15700 at commit [`11b6568`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15737 Yeah, I'd rather just keep it the same. Failures here should be uncommon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15737 **[Test build #68085 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68085/consoleFull)** for PR 15737 at commit [`0efd4e9`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #15759: Pipeline.copy does not create an instance with the same ...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15759 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15759: Bug fix: Pipeline.copy does not create an instanc...

2016-11-03 Thread wojtek-szymanski
GitHub user wojtek-szymanski opened a pull request: https://github.com/apache/spark/pull/15759 Bug fix: Pipeline.copy does not create an instance with the same UID ## What changes were proposed in this pull request? Motivation: `org.apache.spark.ml.Pipeline.copy(extra: P

[GitHub] spark issue #15758: [MINOR] Remove calculation of bucket spec when not expec...

2016-11-03 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15758 Why is this the right thing to do? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15737 Good catch, I just mistakenly changed to AsMS in one place but not both. On the test changes, do you want tests waiting up to 2 minutes * however many kafka calls are being made? If so I

[GitHub] spark issue #15756: [SPARK-18256] Improve the performance of event log repla...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15756 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15756: [SPARK-18256] Improve the performance of event log repla...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15756 **[Test build #68077 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68077/consoleFull)** for PR 15756 at commit [`2717f79`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15756: [SPARK-18256] Improve the performance of event log repla...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15756 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68077/ Test FAILed. ---

[GitHub] spark issue #15327: [SPARK-16575][CORE] partition calculation mismatch with ...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15327 **[Test build #3406 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3406/consoleFull)** for PR 15327 at commit [`18a8554`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15327: [SPARK-16575][CORE] partition calculation mismatch with ...

2016-11-03 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15327 triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark issue #15593: [SPARK-18060][ML] Avoid unnecessary computation for MLOR

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15593 **[Test build #68084 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68084/consoleFull)** for PR 15593 at commit [`210e1d3`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #15593: [SPARK-18060][ML] Avoid unnecessary computation f...

2016-11-03 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15593#discussion_r86434451 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -489,13 +485,14 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark pull request #15593: [SPARK-18060][ML] Avoid unnecessary computation f...

2016-11-03 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15593#discussion_r86433115 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -1486,57 +1489,75 @@ private class LogisticAggregator(

[GitHub] spark pull request #15593: [SPARK-18060][ML] Avoid unnecessary computation f...

2016-11-03 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15593#discussion_r86436188 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -1486,57 +1489,75 @@ private class LogisticAggregator(

[GitHub] spark issue #15737: [SPARK-18212][SS][KAFKA] increase executor poll timeout

2016-11-03 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15737 Two comments: - I think `sc.conf.getTimeAsSeconds("spark.network.timeout", "120s").toString` is still wrong. The suggestion is to make it the following: ```scala val pollTimeoutMs

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15743 **[Test build #68082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68082/consoleFull)** for PR 15743 at commit [`f8aee5d`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15627 **[Test build #68083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68083/consoleFull)** for PR 15627 at commit [`51eefa5`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15758: [MINOR] Remove calculation of bucket spec when not expec...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15758 **[Test build #68081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68081/consoleFull)** for PR 15758 at commit [`2162bfb`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #15743: [SPARK-18236] Reduce duplicate objects in Spark U...

2016-11-03 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15743#discussion_r86435578 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskInfo.scala --- @@ -54,7 +52,7 @@ class TaskInfo( * accumulable to be updated multiple t

[GitHub] spark pull request #15758: [MINOR] Remove calculation of bucket spec when no...

2016-11-03 Thread jaceklaskowski
GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/15758 [MINOR] Remove calculation of bucket spec when not expected ## What changes were proposed in this pull request? Remove calculation of bucket spec when asserted not to have one earlie

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/15743 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #15327: [SPARK-16575][CORE] partition calculation mismatch with ...

2016-11-03 Thread fidato13
Github user fidato13 commented on the issue: https://github.com/apache/spark/pull/15327 ping @rxin @srowen @zsxwing Can you please have a look and advise Jenkins to retest . In this latest commit fixed "SPARK-12527, it is discarded unused. You may specify targets with meta-annotations

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-03 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/15742 Nice catch, from a quick look this seems good. My issue is one of consistency, in previous changes I've made I've used a setter rather that declaring a var on the scala side. I think using a defau

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15743 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15743 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68075/ Test FAILed. ---

[GitHub] spark issue #15743: [SPARK-18236] Reduce duplicate objects in Spark UI and H...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15743 **[Test build #68075 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68075/consoleFull)** for PR 15743 at commit [`f8aee5d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15754: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an init...

2016-11-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15754 Thank you for review and approving, @srowen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15757: [SPARK-18257][SS] Improve error reporting for FileStress...

2016-11-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15757 **[Test build #68080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68080/consoleFull)** for PR 15757 at commit [`e75f4a5`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15757: [SPARK-18257][SS] Improve error reporting for FileStress...

2016-11-03 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15757 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[GitHub] spark pull request #15755: [SPARK-15902][PySpark] Add deprecation warning if...

2016-11-03 Thread krishnakalyan3
Github user krishnakalyan3 closed the pull request at: https://github.com/apache/spark/pull/15755 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request #15757: [SPARK-18257][SS] Improve error reporting for Fil...

2016-11-03 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/15757 [SPARK-18257][SS] Improve error reporting for FileStressSuite ## What changes were proposed in this pull request? This patch improves error reporting for FileStressSuite, when there is an error in

<    1   2   3   4   5   6   >