[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-170721699 **[Test build #49186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49186/consoleFull)** for PR 9524 at commit [`4efc0f0`](https://gith

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/10150#discussion_r49391345 --- Diff: python/pyspark/mllib/clustering.py --- @@ -38,13 +38,120 @@ from pyspark.mllib.util import Saveable, Loader, inherit_doc, JavaLoader, JavaSave

[GitHub] spark pull request: [SPARK-12685] [MLlib] word2vec trainWordsCount...

2016-01-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10627 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12685] [MLlib] word2vec trainWordsCount...

2016-01-11 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/10627#issuecomment-170717118 LGTM Merging with master, and will try to backport to 1.4+ Thanks! --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-12603] [MLlib] PySpark MLlib GaussianMi...

2016-01-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12603] [MLlib] PySpark MLlib GaussianMi...

2016-01-11 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/10552#issuecomment-170715008 LGTM Merging with master Thanks for the PR! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspar...

2016-01-11 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/10707#issuecomment-170714223 Tested example locally, and it worked --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12576][SQL] Enable expression parsing i...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10649#issuecomment-170714313 **[Test build #49184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49184/consoleFull)** for PR 10649 at commit [`81588d2`](https://gi

[GitHub] spark pull request: [SPARK-12756][SQL] use hash expression in Exch...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10703#issuecomment-170714040 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12756][SQL] use hash expression in Exch...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10703#issuecomment-170714042 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-170713843 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12734][HOTFIX] Build changes must trigg...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10704#issuecomment-170713775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-170713845 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-12734][HOTFIX] Build changes must trigg...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10704#issuecomment-170713774 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/10150#discussion_r49389929 --- Diff: python/pyspark/mllib/clustering.py --- @@ -38,13 +38,120 @@ from pyspark.mllib.util import Saveable, Loader, inherit_doc, JavaLoader, JavaSa

[GitHub] spark pull request: [SPARK-12649][SQL] support reading bucketed ta...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10604#issuecomment-170713469 **[Test build #49185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49185/consoleFull)** for PR 10604 at commit [`3a69790`](https://gi

[GitHub] spark pull request: [SPARK-12756][SQL] use hash expression in Exch...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10703#issuecomment-170713648 **[Test build #49165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49165/consoleFull)** for PR 10703 at commit [`8e2f68b`](https://g

[GitHub] spark pull request: [SPARK-12734][HOTFIX] Build changes must trigg...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10704#issuecomment-170713355 **[Test build #49166 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49166/consoleFull)** for PR 10704 at commit [`e99b34a`](https://g

[GitHub] spark pull request: [SPARK-12649][SQL] support reading bucketed ta...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10604#issuecomment-170712550 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12649][SQL] support reading bucketed ta...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10604#issuecomment-170712548 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10509][PYSPARK] Reduce excessive param ...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10216#issuecomment-170712382 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10509][PYSPARK] Reduce excessive param ...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10216#issuecomment-170712385 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10509][PYSPARK] Reduce excessive param ...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10216#issuecomment-170712103 **[Test build #49176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49176/consoleFull)** for PR 10216 at commit [`7aecb59`](https://g

[GitHub] spark pull request: [SPARK-12757][WIP] Use reference counting to p...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10705#issuecomment-170711333 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12757][WIP] Use reference counting to p...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10705#issuecomment-170711337 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12757][WIP] Use reference counting to p...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10705#issuecomment-170711143 **[Test build #49167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49167/consoleFull)** for PR 10705 at commit [`7265784`](https://g

[GitHub] spark pull request: [SPARK-11922][PYSPARK][ML] Python api for ml.f...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10085#issuecomment-170710926 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-170709112 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11922][PYSPARK][ML] Python api for ml.f...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10085#issuecomment-170710756 **[Test build #49177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49177/consoleFull)** for PR 10085 at commit [`798798c`](https://g

[GitHub] spark pull request: [SPARK-11922][PYSPARK][ML] Python api for ml.f...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10085#issuecomment-170710921 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12576][SQL] Enable expression parsing i...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10649#issuecomment-170710543 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12758] [SQL] add note to Spark SQL Migr...

2016-01-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10708 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12576][SQL] Enable expression parsing i...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10649#issuecomment-170710545 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12758] [SQL] add note to Spark SQL Migr...

2016-01-11 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10708#issuecomment-170709905 Thanks, merging to master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12576][SQL] Enable expression parsing i...

2016-01-11 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10649#issuecomment-170709769 @cloud-fan can you also take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-170709115 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-170709106 **[Test build #49178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49178/consoleFull)** for PR 9524 at commit [`6743e93`](https://git

[GitHub] spark pull request: [SPARK-9383][PROJECT-INFRA] PR merge script sh...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10709#issuecomment-170708917 **[Test build #49175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49175/consoleFull)** for PR 10709 at commit [`05aa93c`](https://gi

[GitHub] spark pull request: [SPARK-10387][ML] Add code gen for gbt

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9524#issuecomment-170708503 **[Test build #49178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49178/consoleFull)** for PR 9524 at commit [`6743e93`](https://gith

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-11 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-170707667 I can reproduce the problem using a simple query now: ``` select area, rank() over (partition by area order by month) as c1 from windowData group by produc

[GitHub] spark pull request: [SPARK-10509][PYSPARK] Reduce excessive param ...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10216#issuecomment-170707227 **[Test build #49176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49176/consoleFull)** for PR 10216 at commit [`7aecb59`](https://gi

[GitHub] spark pull request: [SPARK-12576][SQL] Enable expression parsing i...

2016-01-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10649#discussion_r49386798 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystQl.scala --- @@ -41,16 +47,9 @@ private[sql] class CatalystQl(val conf: ParserConf =

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10150#issuecomment-170707177 **[Test build #49181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49181/consoleFull)** for PR 10150 at commit [`c902d93`](https://gi

[GitHub] spark pull request: [SPARK-11922][PYSPARK][ML] Python api for ml.f...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10085#issuecomment-170706592 **[Test build #49177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49177/consoleFull)** for PR 10085 at commit [`798798c`](https://gi

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-170706406 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-170706410 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-170706402 **[Test build #49179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49179/consoleFull)** for PR 9207 at commit [`9525283`](https://git

[GitHub] spark pull request: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Tr...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9207#issuecomment-170705990 **[Test build #49179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49179/consoleFull)** for PR 9207 at commit [`9525283`](https://gith

[GitHub] spark pull request: [pyspark] adding disjunction and difference fu...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10710#issuecomment-170705375 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10150#issuecomment-170705382 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10150#issuecomment-170705376 **[Test build #49174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49174/consoleFull)** for PR 10150 at commit [`0f17577`](https://g

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10150#issuecomment-170705386 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [pyspark] adding disjunction and difference fu...

2016-01-11 Thread abehrens
GitHub user abehrens opened a pull request: https://github.com/apache/spark/pull/10710 [pyspark] adding disjunction and difference functions for rdds I was looking for a way to perform disjunction and difference operations, in other words: * disjunction: find all elements N

[GitHub] spark pull request: [SPARK-12582][Test] IndexShuffleBlockResolverS...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10526#issuecomment-170704868 **[Test build #49173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49173/consoleFull)** for PR 10526 at commit [`174b40f`](https://gi

[GitHub] spark pull request: [SPARK-9383][PROJECT-INFRA] PR merge script sh...

2016-01-11 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10709#issuecomment-170703734 /cc @srowen @ijuma, I finally got around to this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark pull request: [SPARK-9383][PROJECT-INFRA] PR merge script sh...

2016-01-11 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/10709 [SPARK-9383][PROJECT-INFRA] PR merge script should reset back to previous branch when possible This patch modifies our PR merge script to reset back to a named branch when restoring the original

[GitHub] spark pull request: [SPARK-11944][PYSPARK][MLLIB] python mllib.clu...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10150#issuecomment-170703468 **[Test build #49174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49174/consoleFull)** for PR 10150 at commit [`0f17577`](https://gi

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10706#issuecomment-170703108 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10706#issuecomment-170703109 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10706#issuecomment-170703104 **[Test build #49172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49172/consoleFull)** for PR 10706 at commit [`7ae30e1`](https://g

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10706#issuecomment-170702556 **[Test build #49172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49172/consoleFull)** for PR 10706 at commit [`7ae30e1`](https://gi

[GitHub] spark pull request: [SPARK-12758] [SQL] add note to Spark SQL Migr...

2016-01-11 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10708#issuecomment-170701379 Ping @rxin @marmbrus @pwendell , it looks like this was documented in the 1.6 release notes page but it didn't make it into the SQL Programming Guide: https://spark.a

[GitHub] spark pull request: [SPARK-12270][SQL]remove empty space after get...

2016-01-11 Thread huaxingao
Github user huaxingao commented on the pull request: https://github.com/apache/spark/pull/10262#issuecomment-170701187 @yhuai Sorry for the late reply. I waited for my coworker Luciano to come back from vacation today to check with him about his DB2 docker test status. He has a

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170700792 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12758] [SQL] add note to Spark SQL Migr...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10708#issuecomment-170700955 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12582][Test] IndexShuffleBlockResolverS...

2016-01-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10526#issuecomment-170700919 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170700788 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspar...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10707#issuecomment-170700519 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170700549 **[Test build #49164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49164/consoleFull)** for PR 10692 at commit [`a3e3e17`](https://g

[GitHub] spark pull request: [SPARK-12758] [SQL] add note to Spark SQL Migr...

2016-01-11 Thread blbradley
Github user blbradley commented on the pull request: https://github.com/apache/spark/pull/10708#issuecomment-170700621 This contribution is my original work and I license the work to the project under the project's open source license. --- If your project is set up for it, you can re

[GitHub] spark pull request: [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspar...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10707#issuecomment-170700521 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspar...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10707#issuecomment-170700309 **[Test build #49171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49171/consoleFull)** for PR 10707 at commit [`d5d1343`](https://g

[GitHub] spark pull request: [SPARK-12758] [SQL] add note to Spark SQL Migr...

2016-01-11 Thread blbradley
GitHub user blbradley opened a pull request: https://github.com/apache/spark/pull/10708 [SPARK-12758] [SQL] add note to Spark SQL Migration guide about TimestampType casting Warning users about casting changes. You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: [SPARK-12635][SQL] Add ColumnarBatch, an in me...

2016-01-11 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10628#discussion_r49382888 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OffHeapColumnVector.java --- @@ -0,0 +1,162 @@ +package org.apache.spark.sql.e

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170696776 > PY4J zip packaging and source diffs look good to me, so I think this is good-to-go pending tests. This is not ready for merging. I plan to revert our workarou

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170696906 **[Test build #49170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49170/consoleFull)** for PR 10692 at commit [`a3e3e17`](https://gi

[GitHub] spark pull request: [SPARK-12716] [Web UI] Add a TOTALS row to the...

2016-01-11 Thread ajbozarth
Github user ajbozarth commented on the pull request: https://github.com/apache/spark/pull/10668#issuecomment-170695889 @tgravescs I can put together an implementation of that to compare to, I don't know which would look better though, The stages summary doesn't have the same fields as

[GitHub] spark pull request: [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspar...

2016-01-11 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/10707 [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspark.mllib.clustering.KMeans user guide example Fixed WSSSE computeCost in Python mllib KMeans user guide example by using new computeCost method API i

[GitHub] spark pull request: [SPARK-12703][MLLIB][DOC][PYTHON] Fixed pyspar...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10707#issuecomment-170694546 **[Test build #49171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49171/consoleFull)** for PR 10707 at commit [`d5d1343`](https://gi

[GitHub] spark pull request: [SPARK-12642][SQL] improve the hash expression...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10694#issuecomment-170694168 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170694122 PY4J zip packaging and source diffs look good to me, so I think this is good-to-go pending tests. --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request: [SPARK-12642][SQL] improve the hash expression...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10694#issuecomment-170694166 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12745] [SQL] Hive Parser: Limit is not ...

2016-01-11 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10689#issuecomment-170691919 Yeah! I just read the implementation of `Limit`. As you said, the current one is not highly efficient, especially when the number of limits is not small. --- If yo

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170691831 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10706#issuecomment-170690104 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10706#issuecomment-170690101 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12642][SQL] improve the hash expression...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10694#issuecomment-170688749 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12642][SQL] improve the hash expression...

2016-01-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10694#issuecomment-170688753 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12642][SQL] improve the hash expression...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10694#issuecomment-170688430 **[Test build #49162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49162/consoleFull)** for PR 10694 at commit [`74205dc`](https://g

[GitHub] spark pull request: [SPARK-12420][SQL] Have a built-in CSV data so...

2016-01-11 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/10615#discussion_r49377643 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -0,0 +1,228 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-12734][HOTFIX] Build changes must trigg...

2016-01-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10704 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12734][HOTFIX] Build changes must trigg...

2016-01-11 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10704#issuecomment-170687115 Going to merge this now (I SSH'd into the worker running this test and verified that the duplicated JAR wasn't generated). --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-12635][SQL] Add ColumnarBatch, an in me...

2016-01-11 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10628#discussion_r49377063 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OffHeapColumnVector.java --- @@ -0,0 +1,162 @@ +package org.apache.spark.sql.e

[GitHub] spark pull request: [SPARK-12635][SQL] Add ColumnarBatch, an in me...

2016-01-11 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10628#discussion_r49376808 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OffHeapColumnVector.java --- @@ -0,0 +1,162 @@ +package org.apache.spark.sql.e

[GitHub] spark pull request: [SPARK-12635][SQL] Add ColumnarBatch, an in me...

2016-01-11 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10628#discussion_r49376643 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnarBatch.java --- @@ -0,0 +1,291 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-12635][SQL] Add ColumnarBatch, an in me...

2016-01-11 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10628#discussion_r49376528 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnarBatch.java --- @@ -0,0 +1,291 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-12652][PySpark][WIP]Upgrade Py4J to 0.9...

2016-01-11 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10692#issuecomment-170685818 By the way, I packed py4j-0.9.1-src.zip by myself since I could not find it anywhere. --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request: [SPARK-12543] [SQL] [WIP] Subquery in expressi...

2016-01-11 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/10706 [SPARK-12543] [SQL] [WIP] Subquery in expression This PR brings subquery for expression (use subquery as an expression inside SELECT/WHERE/HAVING), for example: ``` select (select 1)

[GitHub] spark pull request: [SPARK-12757][WIP] Use reference counting to p...

2016-01-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10705#issuecomment-170685124 **[Test build #49167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49167/consoleFull)** for PR 10705 at commit [`7265784`](https://gi

[GitHub] spark pull request: [SPARK-12635][SQL] Add ColumnarBatch, an in me...

2016-01-11 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10628#discussion_r49376182 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnarBatch.java --- @@ -0,0 +1,291 @@ +/* + * Licensed to the Apache So

<    1   2   3   4   5   6   7   8   >