[GitHub] spark pull request: [SPARK-13139][SQL] Follow-ups to #11573

2016-03-11 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/11667 [SPARK-13139][SQL] Follow-ups to #11573 ## What changes were proposed in this pull request? Addressing outstanding comments in #11573. ## How was this patch tested? Jen

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55907029 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -100,48 +92,136 @@ private[spark] class MemoryStore( */

[GitHub] spark pull request: [SPARK-13834] Update sbt for 2.x.

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11661#issuecomment-195607575 Any intuition of what caused things to fail? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55906595 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -100,48 +92,136 @@ private[spark] class MemoryStore( */

[GitHub] spark pull request: [SPARK-13811][SPARK-13836] [SQL] Removed IsNot...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11649#issuecomment-195606943 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55906584 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -100,48 +92,136 @@ private[spark] class MemoryStore( */

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55906566 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -717,8 +717,13 @@ private[spark] class BlockManager( level: Sto

[GitHub] spark pull request: [SPARK-13811][SPARK-13836] [SQL] Removed IsNot...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11649#issuecomment-195606944 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55906570 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -793,7 +798,12 @@ private[spark] class BlockManager( // We wi

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55906575 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -520,3 +447,42 @@ private[spark] class MemoryStore( logMemo

[GitHub] spark pull request: [SPARK-13811][SPARK-13836] [SQL] Removed IsNot...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11649#issuecomment-195606806 **[Test build #52954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52954/consoleFull)** for PR 11649 at commit [`baa2cda`](https://g

[GitHub] spark pull request: [SPARK-13834] Update sbt for 2.x.

2016-03-11 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/11661 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-13671] [SPARK-13311] [SQL] Use differen...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11514#issuecomment-195606384 **[Test build #52966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52966/consoleFull)** for PR 11514 at commit [`b3d2df0`](https://gi

[GitHub] spark pull request: [SPARK-13834] Update sbt for 2.x.

2016-03-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11661#issuecomment-195606637 My bad. I'll close this PR now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: [SPARK-13833] Guard against race condition whe...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11660#issuecomment-195606382 **[Test build #52965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52965/consoleFull)** for PR 11660 at commit [`83c1b96`](https://gi

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11659#issuecomment-195606313 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11659#issuecomment-195606316 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10380] Confusing examples in pyspark SQ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11543#issuecomment-195606355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10380] Confusing examples in pyspark SQ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11543#issuecomment-195606238 **[Test build #52961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52961/consoleFull)** for PR 11543 at commit [`9c7bc31`](https://g

[GitHub] spark pull request: [SPARK-10380] Confusing examples in pyspark SQ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11543#issuecomment-195606353 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11659#issuecomment-195606129 **[Test build #52950 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52950/consoleFull)** for PR 11659 at commit [`142b43e`](https://g

[GitHub] spark pull request: [SPARK-XX] [SQL] avoid the copy in HashedRelat...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11666#issuecomment-195605496 **[Test build #52964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52964/consoleFull)** for PR 11666 at commit [`b7393ff`](https://gi

[GitHub] spark pull request: [SPARK-13139][SQL] Create native DDL commands

2016-03-11 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/11048 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13810] [CORE] Add Port Configuration Su...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11644#issuecomment-195604878 looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13810] [CORE] Add Port Configuration Su...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/11644#discussion_r55905764 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2014,8 +2014,10 @@ private[spark] object Utils extends Logging { } catch

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11659#issuecomment-195604813 Merged into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-XXXX][SQL] Support for inferring filter...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11665#issuecomment-195604670 **[Test build #52963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52963/consoleFull)** for PR 11665 at commit [`308e93c`](https://gi

[GitHub] spark pull request: [SPARK-XX] [SQL] avoid the copy in HashedRelat...

2016-03-11 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/11666 [SPARK-XX] [SQL] avoid the copy in HashedRelation ## What changes were proposed in this pull request? Avoid the copy in HashedRelation, since most of the HashedRelation are built with Array

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread vanzin
Github user vanzin closed the pull request at: https://github.com/apache/spark/pull/11662 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11662#issuecomment-195604633 Closing for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-13810] [CORE] Add Port Configuration Su...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11644#issuecomment-195604553 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13810] [CORE] Add Port Configuration Su...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11644#issuecomment-195604555 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13810] [CORE] Add Port Configuration Su...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11644#issuecomment-195604349 **[Test build #52948 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52948/consoleFull)** for PR 11644 at commit [`8177e69`](https://g

[GitHub] spark pull request: [SPARK-XXXX][SQL] Support for inferring filter...

2016-03-11 Thread sameeragarwal
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/11665 [SPARK-][SQL] Support for inferring filters from data constraints ## What changes were proposed in this pull request? **[I'll link it to the JIRA once ASF JIRA is back online]**

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11659 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11659#issuecomment-195604399 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-13776][WebUI]Limit the max number of ac...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11615#issuecomment-195604242 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13776][WebUI]Limit the max number of ac...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11615#issuecomment-195604240 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13776][WebUI]Limit the max number of ac...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11615#issuecomment-195604040 **[Test build #52949 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52949/consoleFull)** for PR 11615 at commit [`e772aed`](https://g

[GitHub] spark pull request: [SPARK-13396] Stop using our internal deprecat...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/11544#discussion_r55905361 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -374,28 +374,30 @@ class JobProgressListener(conf: SparkConf) exte

[GitHub] spark pull request: [SPARK-12583][Mesos] Mesos shuffle service: Do...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11272#issuecomment-195603737 end of month I think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11662#discussion_r55905171 --- Diff: pom.xml --- @@ -2082,23 +2082,6 @@ maven-deploy-plugin 2.8.2 - - org.apache.mave

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11662#discussion_r55905100 --- Diff: pom.xml --- @@ -2082,23 +2082,6 @@ maven-deploy-plugin 2.8.2 - - org.apache.mave

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11663#issuecomment-195603471 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13830] prefer block manager than direct...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11659#issuecomment-195603451 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11663#issuecomment-195603467 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11663#issuecomment-195603328 **[Test build #52960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52960/consoleFull)** for PR 11663 at commit [`40b00dd`](https://g

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11662#discussion_r55904943 --- Diff: pom.xml --- @@ -2082,23 +2082,6 @@ maven-deploy-plugin 2.8.2 - - org.apache.m

[GitHub] spark pull request: [SPARK-XX] [SQL] fast serialization for collec...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11664#issuecomment-195602888 **[Test build #52962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52962/consoleFull)** for PR 11664 at commit [`ac1a40b`](https://gi

[GitHub] spark pull request: [SPARK-13833] Guard against race condition whe...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/11660#discussion_r55904776 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -944,6 +896,85 @@ private[spark] class BlockManager( }

[GitHub] spark pull request: SPARK-13034[ML]:PySpark ml.classification supp...

2016-03-11 Thread GayathriMurali
Github user GayathriMurali commented on the pull request: https://github.com/apache/spark/pull/11582#issuecomment-195602622 @wangmiao1981 I closed my PR. I have made the changes to add persistence to only LogisticRegression and Naive Bayes. Would you like to review? We could then send

[GitHub] spark pull request: [SPARK-XX] [SQL] fast serialization for collec...

2016-03-11 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11664#issuecomment-195602213 cc @nongli @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-XX] [SQL] fast serialization for collec...

2016-03-11 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/11664 [SPARK-XX] [SQL] fast serialization for collecting DataFrame/Dataset ## What changes were proposed in this pull request? When we call DataFrame/Dataset.collect(), Java serializer (or Kryo S

[GitHub] spark pull request: [SPARK-13034] Add export/import for all estima...

2016-03-11 Thread GayathriMurali
Github user GayathriMurali closed the pull request at: https://github.com/apache/spark/pull/11552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request: [SPARK-10380] Confusing examples in pyspark SQ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11543#issuecomment-195601990 **[Test build #52961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52961/consoleFull)** for PR 11543 at commit [`9c7bc31`](https://gi

[GitHub] spark pull request: [SPARK-13739] [SQL] [WIP] Push Predicate Throu...

2016-03-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11635#discussion_r55904257 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -932,6 +933,33 @@ object PushPredicateThroughGenerat

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195600654 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195600655 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195600102 **[Test build #52947 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52947/consoleFull)** for PR 11498 at commit [`9fdde9f`](https://g

[GitHub] spark pull request: [SPARK-13739] [SQL] [WIP] Push Predicate Throu...

2016-03-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11635#discussion_r55903824 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -932,6 +933,33 @@ object PushPredicateThroughGenerat

[GitHub] spark pull request: [SPARK-13739] [SQL] [WIP] Push Predicate Throu...

2016-03-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11635#discussion_r55903702 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -932,6 +933,33 @@ object PushPredicateThroughGenerat

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11663#issuecomment-195599201 **[Test build #52960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52960/consoleFull)** for PR 11663 at commit [`40b00dd`](https://gi

[GitHub] spark pull request: [SPARK-13739] [SQL] [WIP] Push Predicate Throu...

2016-03-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11635#discussion_r55903571 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala --- @@ -268,7 +268,14 @@ package object dsl { Aggregate

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-11 Thread sethah
GitHub user sethah opened a pull request: https://github.com/apache/spark/pull/11663 [SPARK-13068][PYSPARK][ML] Type conversion for Pyspark params ## What changes were proposed in this pull request? This patch adds type conversion functionality for parameters in Pyspark. A

[GitHub] spark pull request: [SPARK-13739] [SQL] [WIP] Push Predicate Throu...

2016-03-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11635#discussion_r55903553 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -932,6 +933,33 @@ object PushPredicateThroughGenerat

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11573 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-11 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11573#issuecomment-195597743 OK. Let's merge this first (to avoid it has conflicts caused by other commits ). We can address the comments in a follow-up PR. --- If your project is set up for it, yo

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-11 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11573#discussion_r55902999 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -64,10 +83,86 @@ private[sql] class SparkQl(conf: ParserConf = SimplePar

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Extend Pyspark para...

2016-03-11 Thread sethah
Github user sethah closed the pull request at: https://github.com/apache/spark/pull/11099 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Extend Pyspark para...

2016-03-11 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/11099#issuecomment-195596930 I'm closing this PR and opening a new one to reflect the changes discussed on the Jira. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-195596524 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-195596522 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13578] [core] Modify launch scripts to ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11591#issuecomment-195596349 **[Test build #52943 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52943/consoleFull)** for PR 11591 at commit [`79e1bf5`](https://g

[GitHub] spark pull request: [SPARK-13576] [build] [test-maven] Don't creat...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11452#issuecomment-195595877 **[Test build #52959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52959/consoleFull)** for PR 11452 at commit [`fda639b`](https://gi

[GitHub] spark pull request: [SPARK-13576] [build] [test-maven] Don't creat...

2016-03-11 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11452#issuecomment-195595600 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11662#issuecomment-195595365 **[Test build #52957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52957/consoleFull)** for PR 11662 at commit [`4996125`](https://g

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11662#issuecomment-195595381 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11662#issuecomment-195595377 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13834] Update sbt for 2.x.

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11661#issuecomment-195593598 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11662#issuecomment-195594084 **[Test build #52957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52957/consoleFull)** for PR 11662 at commit [`4996125`](https://gi

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195593967 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13834] Update sbt for 2.x.

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11661#issuecomment-195593603 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195593973 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13811][SPARK-13836] [SQL] Removed IsNot...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11649#issuecomment-195594081 **[Test build #52958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52958/consoleFull)** for PR 11649 at commit [`55155a7`](https://gi

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195593458 **[Test build #52945 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52945/consoleFull)** for PR 11498 at commit [`c04d3d7`](https://g

[GitHub] spark pull request: [SPARK-13834] Update sbt for 2.x.

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11661#issuecomment-195593457 **[Test build #52955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52955/consoleFull)** for PR 11661 at commit [`e3e62ba`](https://g

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11573#issuecomment-195592073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-XXXX][SQL] Add a strategy for planning ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11646#issuecomment-195592211 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11573#issuecomment-195592071 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-XXXX][SQL] Add a strategy for planning ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11646#issuecomment-195592207 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11613#issuecomment-195592066 **[Test build #52956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52956/consoleFull)** for PR 11613 at commit [`c5a23a4`](https://gi

[GitHub] spark pull request: [minor][build][test-maven] Remove invocation o...

2016-03-11 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/11662 [minor][build][test-maven] Remove invocation of dependency plugin. This avoids noisy output in maven builds, where the classpath of each module would be printed to the terminal. This was

[GitHub] spark pull request: [SPARK-XXXX][SQL] Add a strategy for planning ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11646#issuecomment-195591798 **[Test build #52946 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52946/consoleFull)** for PR 11646 at commit [`35be8d5`](https://g

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195591761 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195591764 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11613#issuecomment-195591625 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11613#issuecomment-195591622 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13139][SQL] Parse Hive DDL commands our...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11573#issuecomment-195591633 **[Test build #52937 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52937/consoleFull)** for PR 11573 at commit [`bd91b0f`](https://g

[GitHub] spark pull request: [SPARK-10907][SPARK-6157] Remove pendingUnroll...

2016-03-11 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/11613#discussion_r55900897 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -520,3 +447,42 @@ private[spark] class MemoryStore( logMem

[GitHub] spark pull request: [SPARK-13653] Split disk writer into separate ...

2016-03-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11498#issuecomment-195591564 **[Test build #52944 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52944/consoleFull)** for PR 11498 at commit [`8b8f4cb`](https://g

<    1   2   3   4   5   6   7   >