[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44357472 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Count.scala --- @@ -32,23 +32,34 @@ case class Count(child: Expressio

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9559#discussion_r44357467 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -193,6 +258,16 @@ private[spark] object HighlyCompressedMapStatus {

[GitHub] spark pull request: [SPARK-11069] [ML] Add RegexTokenizer option t...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9092 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9559#discussion_r44357262 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -141,7 +202,7 @@ private[spark] class HighlyCompressedMapStatus private (

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9559#discussion_r44357246 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -121,6 +123,65 @@ private[spark] class CompressedMapStatus( /**

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9559#discussion_r44357257 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -121,6 +123,65 @@ private[spark] class CompressedMapStatus( /**

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9559#discussion_r44357152 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -121,6 +123,65 @@ private[spark] class CompressedMapStatus( /**

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() (New v...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9579#issuecomment-155248527 **[Test build #45451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45451/consoleFull)** for PR 9579 at commit [`635bbe7`](https://git

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155248415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() (New v...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9579#issuecomment-155248535 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11069] [ML] Add RegexTokenizer option t...

2015-11-09 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9092#issuecomment-155248366 merging with master, branch-1.6 Thank you for the PR! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155248316 **[Test build #45431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45431/consoleFull)** for PR 9428 at commit [`676317b`](https://git

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() (New v...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9579#issuecomment-155248221 **[Test build #45451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45451/consoleFull)** for PR 9579 at commit [`635bbe7`](https://gith

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() (New v...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9579#issuecomment-155248162 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155248180 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() (New v...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9579#issuecomment-155248181 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155248167 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9559#issuecomment-155247985 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155248084 @feynmanliang I think that's the last fix. Thinking more about it, I'm on board with changing LDAModel to be abstract, as long as it's a minor change. I'll se

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9559#issuecomment-155247982 **[Test build #45450 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45450/consoleFull)** for PR 9559 at commit [`e1d1106`](https://git

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-11-09 Thread olarayej
Github user olarayej commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-155247867 I have created a new branch and PR #9579 to follow up on this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() (New v...

2015-11-09 Thread olarayej
GitHub user olarayej opened a pull request: https://github.com/apache/spark/pull/9579 [SPARK-10863][SPARKR] Method coltypes() (New version) This is a follow up on PR #8984, as the corresponding branch for such PR was damaged. You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9559#issuecomment-155247598 **[Test build #45450 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45450/consoleFull)** for PR 9559 at commit [`e1d1106`](https://gith

[GitHub] spark pull request: [spark-11252][network]ShuffleClient should rel...

2015-11-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9227#issuecomment-155247552 A couple of small things left, otherwise LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9559#issuecomment-155247427 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [spark-11252][network]ShuffleClient should rel...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9227#discussion_r44356532 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleClient.java --- @@ -137,9 +137,10 @@ public void registerWithShuffleSe

[GitHub] spark pull request: [SPARK-11267][WIP][Core]Fix the bug that Netty...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9237#issuecomment-155247503 > I'm a little worried that disabling SO_REUSEADDR might cause ugly log messages when you start applications back to back... aside from avoiding inadvertently running in

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9559#issuecomment-155247407 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [spark-11252][network]ShuffleClient should rel...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9227#discussion_r44356452 --- Diff: network/common/src/main/java/org/apache/spark/network/server/TransportChannelHandler.java --- @@ -109,18 +109,22 @@ public void channelRead0(Channel

[GitHub] spark pull request: [spark-11252][network]ShuffleClient should rel...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9227#discussion_r44356351 --- Diff: network/common/src/main/java/org/apache/spark/network/server/TransportChannelHandler.java --- @@ -55,16 +55,19 @@ private final TransportResp

[GitHub] spark pull request: [spark-11252][network]ShuffleClient should rel...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9227#discussion_r44356293 --- Diff: network/common/src/main/java/org/apache/spark/network/TransportContext.java --- @@ -58,15 +58,24 @@ private final TransportConf conf;

[GitHub] spark pull request: [SPARK-11583][Scheduler][Core] Make MapStatus ...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/9559#issuecomment-155247009 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-155246598 **[Test build #45448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45448/consoleFull)** for PR 8559 at commit [`609b61e`](https://gith

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155246626 **[Test build #45446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45446/consoleFull)** for PR 9530 at commit [`a222c03`](https://gith

[GitHub] spark pull request: [SPARK-11296] [SPARK-9026] Modifications to Jo...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/9264#issuecomment-155246650 @reggert I've closed your issue as a duplicate. Can you remove it from the title and use only `SPARK-9026` to avoid potential confusion? --- If your project is set u

[GitHub] spark pull request: [SPARK-11296] [SPARK-9026] Modifications to Jo...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9264#discussion_r44356014 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Utils.scala --- @@ -1,393 +0,0 @@ -/* - * Licensed to th

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44355987 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala --- @@ -177,6 +178,7 @@ object FunctionRegistry {

[GitHub] spark pull request: [SPARK-11593][SQL] Replace catalyst converter ...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9565#issuecomment-155246523 **[Test build #45449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45449/consoleFull)** for PR 9565 at commit [`1e13ff9`](https://gith

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44355961 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -108,7 +109,16 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155246265 > Test build #45434 has finished for PR 9143 at commit 1fe2e7b. > > This patch fails Spark unit tests. > This patch merges cleanly. > This patch adds the

[GitHub] spark pull request: [SPARK-11468][SPARKR] add stddev/variance agg ...

2015-11-09 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/9489#issuecomment-155246119 Looks like dply has aggregate functions for variance, standard deviations ? Can we just match the syntax there ? https://www.rstudio.com/wp-content/uploads/2015/02/data

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44355776 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -525,21 +526,15 @@ class Analyzer( case u @ U

[GitHub] spark pull request: [SPARK-10655][SQL] Adding additional data type...

2015-11-09 Thread sureshthalamati
Github user sureshthalamati commented on the pull request: https://github.com/apache/spark/pull/9162#issuecomment-155245870 @rxin Wondering if I need any additional work on this patch ? Thanks. --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44355675 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala --- @@ -272,7 +273,7 @@ object SqlParser extends AbstractSparkSQLParser with

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-11-09 Thread winningsix
Github user winningsix commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-155245686 Hi @vanzin , I have updated the patch addressing your comments, do some code clean ups and add more tests for cryptocodec. Could you help me review it? Thank you! -

[GitHub] spark pull request: [SPARK-11593][SQL] Replace catalyst converter ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9565#issuecomment-155245715 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11593][SQL] Replace catalyst converter ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9565#issuecomment-155245730 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fix typo in driver page

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9578#issuecomment-155245709 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: Fix typo in driver page

2015-11-09 Thread pestilence669
GitHub user pestilence669 opened a pull request: https://github.com/apache/spark/pull/9578 Fix typo in driver page "Comamnd property" => "Command property" You can merge this pull request into a Git repository by running: $ git pull https://github.com/pestilence669/spark fix_sp

[GitHub] spark pull request: [SPARK-11593][SQL] Replace catalyst converter ...

2015-11-09 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9565#issuecomment-155245604 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155245526 **[Test build #45447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45447/consoleFull)** for PR 9428 at commit [`93c8feb`](https://gith

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-11-09 Thread winningsix
Github user winningsix commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r44355437 --- Diff: core/src/main/scala/org/apache/spark/crypto/CommonConfigurationKeys.scala --- @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-155244934 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155244922 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9428#discussion_r44355235 --- Diff: core/src/test/scala/org/apache/spark/CheckpointSuite.scala --- @@ -251,6 +252,46 @@ class CheckpointSuite extends SparkFunSuite with LocalSparkConte

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155244905 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155244937 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-155244915 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155244901 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11610][MLlib][Python][Docs] Make the do...

2015-11-09 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/9577#issuecomment-155244740 Thanks for merging it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155244104 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11468][SPARKR] add stddev/variance agg ...

2015-11-09 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/9489#issuecomment-155244366 @mengxr possibly.. though there are usage difference with SparkR DataFrame/Column as compared to R data.frame (eg. `agg` vs [`aggregate`](https://stat.ethz.ch/R-man

[GitHub] spark pull request: [SPARK-11069] [ML] Add RegexTokenizer option t...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9092#issuecomment-155243776 **[Test build #45439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45439/consoleFull)** for PR 9092 at commit [`2663cbf`](https://git

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155243910 **[Test build #45416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45416/consoleFull)** for PR 8639 at commit [`785e4ae`](https://git

[GitHub] spark pull request: [SPARK-11069] [ML] Add RegexTokenizer option t...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9092#issuecomment-155244180 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155243816 LGTM If we do decide to change the inheritance structure it should be done before 1.6 release to prevent breaking public APIs --- If your project is set u

[GitHub] spark pull request: [SPARK-11610][MLlib][Python][Docs] Make the do...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9577 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44354764 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,668 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-11610][MLlib][Python][Docs] Make the do...

2015-11-09 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9577#issuecomment-155242262 Merging with master and branch-1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44354690 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,668 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44354638 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,668 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-11564][SQL] Fix documentation for DataF...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9557 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11610][MLlib][Python][Docs] Make the do...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9577#issuecomment-155241916 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11610][MLlib][Python][Docs] Make the do...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9577#issuecomment-155241813 **[Test build #45441 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45441/consoleFull)** for PR 9577 at commit [`e07f118`](https://git

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-11-09 Thread winningsix
Github user winningsix commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r44354373 --- Diff: core/src/test/scala/org/apache/spark/crypto/JceAesCtrCryptoCodecSuite.scala --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11564][SQL] Fix documentation for DataF...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9557#issuecomment-155241396 **[Test build #2021 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2021/consoleFull)** for PR 9557 at commit [`8d10a25`](https://gi

[GitHub] spark pull request: [SPARK-7841][BUILD] Stop using retrieveManaged...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155241291 **[Test build #45444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45444/consoleFull)** for PR 9575 at commit [`828c3b4`](https://gith

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155241173 **[Test build #45445 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45445/consoleFull)** for PR 9143 at commit [`1fe2e7b`](https://gith

[GitHub] spark pull request: [SPARK-7841][BUILD] Stop using retrieveManaged...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155240995 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7841][BUILD] Stop using retrieveManaged...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155241014 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155241026 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155240999 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7841][BUILD] Stop using retrieveManaged...

2015-11-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155240441 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11590][SQL] use native json_tuple in la...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9562#discussion_r44353866 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1448,4 +1448,21 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread brkyvz
Github user brkyvz commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155240395 Failed to a flaky test. Restarting --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread brkyvz
Github user brkyvz commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155240408 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9555 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10393] use ML pipeline in LDA example

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8551#issuecomment-155240352 **[Test build #2026 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2026/consoleFull)** for PR 8551 at commit [`ee4832d`](https://git

[GitHub] spark pull request: [SPARK-11590][SQL] use native json_tuple in la...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9562#discussion_r44353792 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -749,10 +749,14 @@ class DataFrame private[sql]( // will remove intermed

[GitHub] spark pull request: [SPARK-11572] Exit AsynchronousListenerBus thr...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9546#discussion_r44353658 --- Diff: core/src/main/scala/org/apache/spark/util/AsynchronousListenerBus.scala --- @@ -66,6 +66,7 @@ private[spark] abstract class AsynchronousListenerB

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155240080 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155239960 **[Test build #45422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45422/consoleFull)** for PR 9403 at commit [`932485a`](https://git

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155240029 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155240086 **[Test build #2025 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2025/consoleFull)** for PR 9513 at commit [`16a061c`](https://git

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155239894 **[Test build #45425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45425/consoleFull)** for PR 9555 at commit [`0a5a161`](https://git

[GitHub] spark pull request: [SPARK-11590][SQL] use native json_tuple in la...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9562#discussion_r44353530 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -749,10 +749,14 @@ class DataFrame private[sql]( // will remove intermed

[GitHub] spark pull request: [SPARK-11360] [Doc] Loss of nullability when w...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9314 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11069] [ML] Add RegexTokenizer option t...

2015-11-09 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/9092#issuecomment-155239682 LGTM pending tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155239475 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155239389 **[Test build #45434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45434/consoleFull)** for PR 9143 at commit [`1fe2e7b`](https://git

<    1   2   3   4   5   6   7   8   9   10   >