[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #66650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66650/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15389 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14745: [SPARK-16896][SQL] Handle duplicated field names in head...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14745 **[Test build #66652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66652/consoleFull)** for PR 14745 at commit

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15389 **[Test build #66651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66651/consoleFull)** for PR 15389 at commit

[GitHub] spark issue #15292: [SPARK-17719][SPARK-17776][SQL] Unify and tie up options...

2016-10-10 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15292 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15292: [SPARK-17719][SPARK-17776][SQL] Unify and tie up options...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15292 **[Test build #66653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66653/consoleFull)** for PR 15292 at commit

[GitHub] spark issue #15417: [SPARK-17851][SQL][MINOR][TESTS] Update invalid test sql...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15417 **[Test build #3315 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3315/consoleFull)** for PR 15417 at commit

[GitHub] spark issue #14788: [SPARK-17174][SQL] Add the support for TimestampType for...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14788 **[Test build #3316 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3316/consoleFull)** for PR 14788 at commit

[GitHub] spark pull request #14788: [SPARK-17174][SQL] Add the support for TimestampT...

2016-10-10 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14788#discussion_r82604495 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -2548,16 +2548,20 @@ object functions { def to_date(e: Column):

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15382 **[Test build #3314 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3314/consoleFull)** for PR 15382 at commit

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-10-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13775 @rxin Thanks for looking at this! 1. My initial investigation when implementing this PR is looking at this direction too. Because this is waiting for a while, I can only remember that

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15297 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15418 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66644/ Test PASSed. ---

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15418 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #66648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66648/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15418 **[Test build #66644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66644/consoleFull)** for PR 15418 at commit

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15418 **[Test build #66642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66642/consoleFull)** for PR 15418 at commit

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15418 Merged to master to unblock other PR tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #66648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66648/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15418 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66648/ Test FAILed. ---

[GitHub] spark issue #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `SparkSq...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15418 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66642/ Test PASSed. ---

[GitHub] spark issue #15414: [SPARK-17848][ML] Move LabelCol datatype cast into Predi...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15414 **[Test build #66649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66649/consoleFull)** for PR 15414 at commit

[GitHub] spark issue #15414: [SPARK-17848][ML] Move LabelCol datatype cast into Predi...

2016-10-10 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15414 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15418: [HOT-FIX][SQL][TESTS] Remove unused function in `...

2016-10-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15418 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15416: [SPARK-17849] [SQL] Fix NPE problem when using grouping ...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15416 **[Test build #3309 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3309/consoleFull)** for PR 15416 at commit

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14136 **[Test build #3307 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3307/consoleFull)** for PR 14136 at commit

[GitHub] spark issue #15417: [SPARK-17851][SQL][MINOR][TESTS] Update invalid test sql...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15417 **[Test build #3305 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3305/consoleFull)** for PR 15417 at commit

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15389 **[Test build #3306 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3306/consoleFull)** for PR 15389 at commit

[GitHub] spark issue #15419: [SPARK-17828] [DOCS] Remove unused generate-changelist.p...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15419 **[Test build #3304 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3304/consoleFull)** for PR 15419 at commit

[GitHub] spark issue #15319: [SPARK-17733][SQL] InferFiltersFromConstraints rule neve...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15319 **[Test build #3308 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3308/consoleFull)** for PR 15319 at commit

[GitHub] spark issue #15386: [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15386 **[Test build #3312 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3312/consoleFull)** for PR 15386 at commit

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15382 **[Test build #3310 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3310/consoleFull)** for PR 15382 at commit

[GitHub] spark issue #15292: [SPARK-17719][SPARK-17776][SQL] Unify and tie up options...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15292 **[Test build #3311 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3311/consoleFull)** for PR 15292 at commit

[GitHub] spark issue #14788: [SPARK-17174][SQL] Add the support for TimestampType for...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14788 **[Test build #3313 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3313/consoleFull)** for PR 14788 at commit

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14136 **[Test build #3307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3307/consoleFull)** for PR 14136 at commit

[GitHub] spark issue #15386: [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15386 **[Test build #3312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3312/consoleFull)** for PR 15386 at commit

[GitHub] spark issue #15314: [SPARK-17747][ML] WeightCol support non-double datatypes

2016-10-10 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/15314 @srowen Feel free. It was a small fix that only modify `getNumClasses` in that jira before we tend to move cast to `Predictor`. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15319: [SPARK-17733][SQL] InferFiltersFromConstraints rule neve...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15319 **[Test build #3308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3308/consoleFull)** for PR 15319 at commit

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15389 **[Test build #3306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3306/consoleFull)** for PR 15389 at commit

[GitHub] spark issue #15417: [SPARK-17851][SQL][MINOR][TESTS] Update invalid test sql...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15417 **[Test build #3305 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3305/consoleFull)** for PR 15417 at commit

[GitHub] spark issue #15292: [SPARK-17719][SPARK-17776][SQL] Unify and tie up options...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15292 **[Test build #3311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3311/consoleFull)** for PR 15292 at commit

[GitHub] spark issue #14788: [SPARK-17174][SQL] Add the support for TimestampType for...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14788 **[Test build #3313 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3313/consoleFull)** for PR 14788 at commit

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15297 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15382 **[Test build #3310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3310/consoleFull)** for PR 15382 at commit

[GitHub] spark pull request #15346: [SPARK-17741][SQL] Grammar to parse top level and...

2016-10-10 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15346#discussion_r82588951 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -68,9 +87,134 @@ class SparkSqlParserSuite extends

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #66647 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66647/consoleFull)** for PR 15297 at commit

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66647/ Test FAILed. ---

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15297 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15297: [WIP][SPARK-9862]Handling data skew

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15297 **[Test build #66647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66647/consoleFull)** for PR 15297 at commit

[GitHub] spark pull request #15420: [SPARK-17855][CORE] Remove query string from jar ...

2016-10-10 Thread invkrh
Github user invkrh commented on a diff in the pull request: https://github.com/apache/spark/pull/15420#discussion_r82610440 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -147,7 +147,8 @@ private[deploy] class DriverRunner( * Will

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15389 **[Test build #66654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66654/consoleFull)** for PR 15389 at commit

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15389 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15389: [SPARK-17817][PySpark] PySpark RDD Repartitioning Result...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15389 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66654/ Test PASSed. ---

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-10 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15397 Look at the poll/seek implementation in the DStream's subscribe and subscribe pattern when user offsets are provided, i.e. the problem that triggered this ticket to begin with. You're going

[GitHub] spark issue #15387: [SPARK-17782][STREAMING][KAFKA] eliminate race condition...

2016-10-10 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15387 If you're worried about it then accept the alternative PR I linked. On Sun, Oct 9, 2016 at 11:37 PM, Shixiong Zhu wrote: > During the original

[GitHub] spark issue #13194: [SPARK-15402] [ML] [PySpark] PySpark ml.evaluation shoul...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13194 **[Test build #5 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/5/consoleFull)** for PR 13194 at commit

[GitHub] spark issue #13675: [SPARK-15957] [ML] RFormula supports forcing to index la...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13675 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15371 **[Test build #9 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/9/consoleFull)** for PR 15371 at commit

[GitHub] spark pull request #15408: [SPARK-17839][CORE] UnsafeSorterSpillReader shoul...

2016-10-10 Thread sitalkedia
Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/15408#discussion_r82649972 --- Diff: core/src/main/java/org/apache/spark/io/NioBasedBufferedFileInputStream.java --- @@ -0,0 +1,120 @@ +/* + * Licensed under the Apache

[GitHub] spark issue #15342: [SPARK-11560] [MLLIB] Optimize KMeans implementation / r...

2016-10-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15342 @sethah OK I will add a new overload of `train` and deprecate the others. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15408: [SPARK-17839][CORE] Use Nio's directbuffer instead of Bu...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15408 **[Test build #66674 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66674/consoleFull)** for PR 15408 at commit

[GitHub] spark issue #15419: [SPARK-17828] [DOCS] Remove unused generate-changelist.p...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15419 **[Test build #3318 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3318/consoleFull)** for PR 15419 at commit

[GitHub] spark issue #13675: [SPARK-15957] [ML] RFormula supports forcing to index la...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13675 **[Test build #1 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1/consoleFull)** for PR 13675 at commit

[GitHub] spark issue #13675: [SPARK-15957] [ML] RFormula supports forcing to index la...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13675 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13675: [SPARK-15957] [ML] RFormula supports forcing to index la...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13675 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/1/ Test FAILed. ---

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-10 Thread invkrh
Github user invkrh commented on the issue: https://github.com/apache/spark/pull/15420 @srowen I have tested the code on spark 1.6.2. It works fine. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #15316: [SPARK-17751] [SQL] Remove spark.sql.eagerAnalysi...

2016-10-10 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15316#discussion_r82643571 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/AnalysisException.scala --- @@ -43,6 +43,11 @@ class AnalysisException protected[sql] (

[GitHub] spark pull request #15408: [SPARK-17839][CORE] UnsafeSorterSpillReader shoul...

2016-10-10 Thread sitalkedia
Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/15408#discussion_r82647539 --- Diff: core/src/main/java/org/apache/spark/io/NioBasedBufferedFileInputStream.java --- @@ -0,0 +1,120 @@ +/* + * Licensed under the Apache

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-10 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82647560 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/BLAS.scala --- @@ -244,6 +244,15 @@ private[spark] object BLAS extends Serializable {

[GitHub] spark issue #15316: [SPARK-17751] [SQL] Remove spark.sql.eagerAnalysis and O...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15316 **[Test build #8 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/8/consoleFull)** for PR 15316 at commit

[GitHub] spark issue #15408: [SPARK-17839][CORE] UnsafeSorterSpillReader should use N...

2016-10-10 Thread sitalkedia
Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/15408 Thanks @srowen, @rxin for the review comments. I have addressed them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15386: [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4...

2016-10-10 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/15386 Thanks @srowen , I wasn't aware of that script. Hopefully this should be good to go now! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15408: [SPARK-17839][CORE] UnsafeSorterSpillReader should use N...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15408 **[Test build #66671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66671/consoleFull)** for PR 15408 at commit

[GitHub] spark issue #15342: [SPARK-11560] [MLLIB] Optimize KMeans implementation / r...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15342 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15342: [SPARK-11560] [MLLIB] Optimize KMeans implementation / r...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15342 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66673/ Test FAILed. ---

[GitHub] spark pull request #15358: [SPARK-17783] [SQL] Hide Credentials in CREATE an...

2016-10-10 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15358#discussion_r82655758 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -52,9 +52,15 @@ case class CatalogStorageFormat(

[GitHub] spark pull request #15408: [SPARK-17839][CORE] Use Nio's directbuffer instea...

2016-10-10 Thread sitalkedia
Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/15408#discussion_r82655690 --- Diff: core/src/main/java/org/apache/spark/io/NioBasedBufferedFileInputStream.java --- @@ -0,0 +1,120 @@ +/* + * Licensed under the Apache

[GitHub] spark issue #15419: [SPARK-17828] [DOCS] Remove unused generate-changelist.p...

2016-10-10 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15419 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15392: [SPARK-17830] Annotate spark.sql package with InterfaceS...

2016-10-10 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15392 LGTM, merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15392: [SPARK-17830] Annotate spark.sql package with Int...

2016-10-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15392 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14897: [SPARK-17338][SQL] add global temp view

2016-10-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14897#discussion_r82658710 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2433,31 +2433,65 @@ class Dataset[T] private[sql]( } /** -

[GitHub] spark pull request #14897: [SPARK-17338][SQL] add global temp view

2016-10-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14897#discussion_r82658771 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2433,31 +2433,65 @@ class Dataset[T] private[sql]( } /** -

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14731 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66656/ Test PASSed. ---

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14731 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14731 **[Test build #66656 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66656/consoleFull)** for PR 14731 at commit

[GitHub] spark issue #14653: [SPARK-10931][PYSPARK][ML] PySpark ML Models should cont...

2016-10-10 Thread davidnavas
Github user davidnavas commented on the issue: https://github.com/apache/spark/pull/14653 @holdenk happy to help if I can, is there something a mere mortal like myself can accomplish? [dunno how to poke jenkins hereabouts] --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15342: [SPARK-11560] [MLLIB] Optimize KMeans implementat...

2016-10-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15342#discussion_r82652315 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala --- @@ -258,149 +252,106 @@ class KMeans private ( } }

[GitHub] spark issue #10342: [SPARK-12388] change default compression to lz4

2016-10-10 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/10342 One thing I noticed when I was reviewing another pr just now: in the future we should also include test cases when pulling in 3rd party code. Otherwise it's pretty difficult to ensure correctness if

[GitHub] spark issue #15319: [SPARK-17733][SQL] InferFiltersFromConstraints rule neve...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15319 **[Test build #66658 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66658/consoleFull)** for PR 15319 at commit

[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...

2016-10-10 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14365 @cloud-fan actually, this conversion was disabled because of this bug. btw, pr that @cloud-fan mentioned is https://github.com/apache/spark/pull/14690. I think it is better to hold

[GitHub] spark pull request #14897: [SPARK-17338][SQL] add global temp view

2016-10-10 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14897#discussion_r82658617 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalog/Catalog.scala --- @@ -262,15 +262,33 @@ abstract class Catalog { options: Map[String,

[GitHub] spark issue #15399: [SPARK-17819][SQL] Support default database in connectio...

2016-10-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15399 Hi, @liancheng . Could you review this PR about Thrift Server? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15408: [SPARK-17839][CORE] UnsafeSorterSpillReader should use N...

2016-10-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15408 **[Test build #7 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/7/consoleFull)** for PR 15408 at commit

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-10 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82648263 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -217,7 +215,7 @@ class LinearRegression @Since("1.3.0")

[GitHub] spark pull request #15342: [SPARK-11560] [MLLIB] Optimize KMeans implementat...

2016-10-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15342#discussion_r82649829 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala --- @@ -258,149 +252,106 @@ class KMeans private ( } }

[GitHub] spark pull request #15342: [SPARK-11560] [MLLIB] Optimize KMeans implementat...

2016-10-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15342#discussion_r82649893 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala --- @@ -258,149 +252,106 @@ class KMeans private ( } }

[GitHub] spark issue #15386: [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4...

2016-10-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15386 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66672/ Test FAILed. ---

  1   2   3   4   5   6   7   8   >