[GitHub] spark pull request: [SPARK-6350][Mesos] Make mesosExecutorCores co...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5063#issuecomment-86841449 [Test build #29285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29285/consoleFull) for PR 5063 at commit

[GitHub] spark pull request: [SPARK-6556][Core] Fix wrong parsing logic of ...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5209#issuecomment-86846222 [Test build #29288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29288/consoleFull) for PR 5209 at commit

[GitHub] spark pull request: [SQL] [Minor] Loose the the resolving check

2015-03-27 Thread chenghao-intel
GitHub user chenghao-intel opened a pull request: https://github.com/apache/spark/pull/5224 [SQL] [Minor] Loose the the resolving check You can merge this pull request into a Git repository by running: $ git pull https://github.com/chenghao-intel/spark patch-1 Alternatively

[GitHub] spark pull request: [SPARK-6553] [pyspark] Support functools.parti...

2015-03-27 Thread ksonj
Github user ksonj commented on the pull request: https://github.com/apache/spark/pull/5206#issuecomment-86850891 Hi, I like name = f.__name__ if hasattr(f, “__name__) else f.__class__.__name__ as that should even work for oldstyle callables. --- If your

[GitHub] spark pull request: [SPARK-6341][mllib] Upgrade breeze from 0.11.1...

2015-03-27 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/5222#issuecomment-86856462 @mengxr sorry for re-open this PR. Have this PR been merged? I couldn't see the commit log in the master branch. https://github.com/apache/spark/commits/master --- If

[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-86838175 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6350][Mesos] Make mesosExecutorCores co...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5063#issuecomment-86841450 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6341][mllib] Upgrade breeze from 0.11.1...

2015-03-27 Thread yu-iskw
GitHub user yu-iskw reopened a pull request: https://github.com/apache/spark/pull/5222 [SPARK-6341][mllib] Upgrade breeze from 0.11.1 to 0.11.2 There are any bugs of breeze's SparseVector at 0.11.1. You know, Spark 1.3 depends on breeze 0.11.1. So I think we should upgrade it to

[GitHub] spark pull request: [SPARK-6350][Mesos] Make mesosExecutorCores co...

2015-03-27 Thread jongyoul
Github user jongyoul commented on the pull request: https://github.com/apache/spark/pull/5063#issuecomment-86841550 @sryza Review it again, please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] [Minor] Loose the the resolving check

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5224#issuecomment-86847202 [Test build #29290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29290/consoleFull) for PR 5224 at commit

[GitHub] spark pull request: [SPARK-4233] [SQL] WIP:Simplify the UDAF API (...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3247#issuecomment-86849238 [Test build #29291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29291/consoleFull) for PR 3247 at commit

[GitHub] spark pull request: [SPARK-5886][ML] Add label indexer

2015-03-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/4735#discussion_r27279180 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LabelIndexer.scala --- @@ -0,0 +1,126 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-6556][Core] Fix wrong parsing logic of ...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5209#issuecomment-86846252 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-86840184 [Test build #12 has started](https://hadrian.millennium.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/12/consoleFull) for PR 5173 at commit

[GitHub] spark pull request: [SPARK-6521][Core]executors in the same node r...

2015-03-27 Thread viper-kun
Github user viper-kun commented on the pull request: https://github.com/apache/spark/pull/5178#issuecomment-86849484 Hi @andrewor14. pls retest it, test build time out. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-6341][mllib] Upgrade breeze from 0.11.1...

2015-03-27 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/5222#issuecomment-86852093 LGTM. Merged into master and branch-1.3. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6341][mllib] Upgrade breeze from 0.11.1...

2015-03-27 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/5222#issuecomment-86852400 @mengxr Thank you for merging it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-6341][mllib] Upgrade breeze from 0.11.1...

2015-03-27 Thread yu-iskw
Github user yu-iskw closed the pull request at: https://github.com/apache/spark/pull/5222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-86838162 [Test build #29284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29284/consoleFull) for PR 5173 at commit

[GitHub] spark pull request: [SPARK-6406] Launch Spark using assembly jar i...

2015-03-27 Thread nishkamravi2
Github user nishkamravi2 commented on the pull request: https://github.com/apache/spark/pull/5085#issuecomment-86850717 Addressed comments, fixed a couple of bugs. Can this be retested? Thanks. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support

2015-03-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5173#discussion_r27279604 --- Diff: python/pyspark/sql/dataframe.py --- @@ -294,10 +301,11 @@ def count(self): which supports features such as filter pushdown.

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5225#issuecomment-86862946 [Test build #29292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29292/consoleFull) for PR 5225 at commit

[GitHub] spark pull request: [SQL] [Minor] Loose the the resolving check

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5224#issuecomment-86865029 [Test build #29290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29290/consoleFull) for PR 5224 at commit

[GitHub] spark pull request: [Minor] [SQL] Follow-up of PR #5210

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5219#issuecomment-86865165 [Test build #29294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29294/consoleFull) for PR 5219 at commit

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/5225#discussion_r27280637 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -730,6 +731,23 @@ class DataFrame private[sql]( Generate(generator,

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86899715 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-6255] [MLLIB] Support multiclass classi...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5137#issuecomment-86905141 [Test build #29298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29298/consoleFull) for PR 5137 at commit

[GitHub] spark pull request: [SPARK-6255] [MLLIB] Support multiclass classi...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5137#issuecomment-86905148 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5563][mllib] online lda initial checkin

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4419#issuecomment-86905181 [Test build #29299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29299/consoleFull) for PR 4419 at commit

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5227#issuecomment-86905206 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5563][mllib] online lda initial checkin

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4419#issuecomment-86905203 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5226#issuecomment-86899401 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5226#issuecomment-86899392 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SQL][SPARK-6471]: Metastore schema should onl...

2015-03-27 Thread saucam
Github user saucam commented on the pull request: https://github.com/apache/spark/pull/5141#issuecomment-86900047 Sorry for so many queries . How about if I simply ignore reading schema from parquet part files, relying only on metastore schema (I will pass it from

[GitHub] spark pull request: [Spark-5111][SQL]HiveContext and Thriftserver ...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/4064#issuecomment-86889339 @zhzhan Would you mind to give a summary of the code added in this PR? I feel kinda hesitant to have this... Mostly because Spark doesn't explicitly support Hadoop

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread dreamquster
GitHub user dreamquster opened a pull request: https://github.com/apache/spark/pull/5228 [SQL] SPARK-6548 : Adding stddev to DataFrame functions The contribution is my original work and that my license the work to the project under the project's open source license. sdfox

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86895986 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5226#issuecomment-86902391 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5227#issuecomment-86905186 [Test build #29297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29297/consoleFull) for PR 5227 at commit

[GitHub] spark pull request: [SPARK-6521][Core]executors in the same node r...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5178#issuecomment-86906368 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6521][Core]executors in the same node r...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5178#issuecomment-86906360 **[Test build #29296 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29296/consoleFull)** for PR 5178 at commit

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86902390 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread dreamquster
Github user dreamquster commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86904133 ![image](https://cloud.githubusercontent.com/assets/4962716/6866637/5a6a7fd2-d4b5-11e4-961c-396907782bef.png) What's wrong with this? --- If your project is set

[GitHub] spark pull request: [SQL][SPARK-6471]: Metastore schema should onl...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5141#issuecomment-86904108 Unfortunately Hive is case insensitive and assumes all fields nullable (including nested fields in complex types), while for Parquet both case information and

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/5226 [SPARK-6564][SQL] SQLContext.emptyDataFrame should contain 0 row, not 1 row You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark empty-df

[GitHub] spark pull request: [Minor] [SQL] Follow-up of PR #5210

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5219#issuecomment-86864740 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6406] Launch Spark using assembly jar i...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5085#issuecomment-86868475 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6406] Launch Spark using assembly jar i...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5085#issuecomment-86868649 [Test build #29295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29295/consoleFull) for PR 5085 at commit

[GitHub] spark pull request: [SQL][SPARK-6471]: Metastore schema should onl...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5141#issuecomment-86868735 @saucam I believe #5214 covers the scenario you mentioned. You may refer to [this comment] [1] of mine in #5188 (which was later superceded by #5214). [1]:

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5227#issuecomment-86883332 [Test build #29297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29297/consoleFull) for PR 5227 at commit

[GitHub] spark pull request: [SPARK-5563][mllib] online lda initial checkin

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4419#issuecomment-86883524 [Test build #29299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29299/consoleFull) for PR 4419 at commit

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5225#issuecomment-86885362 **[Test build #29292 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29292/consoleFull)** for PR 5225 at commit

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5225#issuecomment-86885390 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-86861703 [Test build #12 has finished](https://hadrian.millennium.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/12/consoleFull) for PR 5173 at commit

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5226#issuecomment-86864084 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5226#issuecomment-86864081 [Test build #29293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29293/consoleFull) for PR 5226 at commit

[GitHub] spark pull request: [SQL] [Minor] Loose the the resolving check

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5224#issuecomment-86865038 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Minor] [SQL] Follow-up of PR #5210

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5219#issuecomment-86865352 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Minor] [SQL] Follow-up of PR #5210

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5219#issuecomment-86865350 [Test build #29294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29294/consoleFull) for PR 5219 at commit

[GitHub] spark pull request: [SQL][SPARK-6471]: Metastore schema should onl...

2015-03-27 Thread saucam
Github user saucam commented on the pull request: https://github.com/apache/spark/pull/5141#issuecomment-86880657 Hi @liancheng , thanks for the references, I have already gone through these , but I was talking about ParquetRelation (old parquet path, the default one in spark 1.2)

[GitHub] spark pull request: [SQL][SPARK-6471]: Metastore schema should onl...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5141#issuecomment-86882056 Oh sorry, I thought you were just using `ParquetRelation` as an example. Actually we're trying to replace `ParquetRelation` entirely with `ParquetRelation2`, probably

[GitHub] spark pull request: [SPARK-6521][Core]executors in the same node r...

2015-03-27 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/5178#issuecomment-86878577 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-6406] Launch Spark using assembly jar i...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5085#issuecomment-86885995 [Test build #29295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29295/consoleFull) for PR 5085 at commit

[GitHub] spark pull request: [SPARK-6406] Launch Spark using assembly jar i...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5085#issuecomment-86886035 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5225#discussion_r27279996 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -730,6 +731,23 @@ class DataFrame private[sql]( Generate(generator, join =

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/5225 [SPARK-6119][SQL] DataFrame.dropna You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark df-dropna Alternatively you can review and apply

[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame.dropna

2015-03-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5225#issuecomment-86861842 cc @davies for Python --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6564][SQL] SQLContext.emptyDataFrame sh...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5226#issuecomment-86863904 [Test build #29293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29293/consoleFull) for PR 5226 at commit

[GitHub] spark pull request: [SPARK-6538][SQL] Add missing nullable Metasto...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5188#issuecomment-86868423 Just for future referece, #5214 supercedes this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-03-27 Thread tsudukim
GitHub user tsudukim opened a pull request: https://github.com/apache/spark/pull/5227 [SPARK-6435] spark-shell --jars option does not add all jars to classpath Modified to accept double-quotated args properly in spark-shell.cmd. You can merge this pull request into a Git repository

[GitHub] spark pull request: [SPARK-4233] [SQL] WIP:Simplify the UDAF API (...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3247#issuecomment-86860948 [Test build #29291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29291/consoleFull) for PR 3247 at commit

[GitHub] spark pull request: [SPARK-4233] [SQL] WIP:Simplify the UDAF API (...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3247#issuecomment-86860962 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6521][Core]executors in the same node r...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5178#issuecomment-86879709 [Test build #29296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29296/consoleFull) for PR 5178 at commit

[GitHub] spark pull request: [SPARK-6255] [MLLIB] Support multiclass classi...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5137#issuecomment-86883508 [Test build #29298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29298/consoleFull) for PR 5137 at commit

[GitHub] spark pull request: [SPARK-6552][Deploy][Doc]expose start-slave.sh...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5205#issuecomment-86926386 So, it looks like `start-slaves.sh` reads these variables in order to pass them as arguments to `start-slave.sh`. Am I right about that? if so, then no I do not think

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-86928569 [Test build #29304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29304/consoleFull) for PR 4229 at commit

[GitHub] spark pull request: [SPARK-6560][CORE] Do not suppress exceptions ...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5223#issuecomment-86928639 I like the idea. What I slightly don't like is making a utility method but then using it to solve just one instance of the issue. I think that this doesn't need to apply

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-86928712 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27292233 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. /tr /table +### Shuffle operations + +Certain

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27292232 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. /tr /table +### Shuffle operations + +Certain

[GitHub] spark pull request: [SPARK-6544][build] Increment Avro version fro...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5193#issuecomment-86926513 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-6556][Core] Fix wrong parsing logic of ...

2015-03-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5209 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6544][build] Increment Avro version fro...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5193#issuecomment-86927852 [Test build #29303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29303/consoleFull) for PR 5193 at commit

[GitHub] spark pull request: [SPARK-5155] [PySpark] [Streaming] Mqtt stream...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4229#issuecomment-86928710 [Test build #29304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29304/consoleFull) for PR 4229 at commit

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5227#issuecomment-86915128 I tend to trust your judgment on modifying these Windows scripts, especially if you've verified that this works where it did not before. CC @nishkamravi2 and @vanzin

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86924663 [Test build #29302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29302/consoleFull) for PR 5228 at commit

[GitHub] spark pull request: Aditional information for users building from ...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5092#issuecomment-86925265 @igorcosta are you going to update this PR accordingly or do you want me to edit on merge? it would be almost like making a new PR so I wanted to check first. --- If

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86921721 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86925021 [Test build #29302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29302/consoleFull) for PR 5228 at commit

[GitHub] spark pull request: [SQL] SPARK-6548 : Adding stddev to DataFrame ...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5228#issuecomment-86925027 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6341][mllib] Upgrade breeze from 0.11.1...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5222#issuecomment-86928260 @yu-iskw It looks like there was some delay in the git sync or something. You can see that after your last message, the commits do appear in `master` and `branch-1.3`, so

[GitHub] spark pull request: [SPARK-4123][Project Infra]: Show new dependen...

2015-03-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5093#discussion_r27293445 --- Diff: dev/tests/pr_new_dependencies.sh --- @@ -0,0 +1,115 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5115#issuecomment-86941001 @achanda are you in a position to change this PR according to the last round of comments? basically I don't want to change the behavior at all, just get the URI logic in

[GitHub] spark pull request: [SPARK-6558] Utils.getCurrentUserName returns ...

2015-03-27 Thread tgravescs
GitHub user tgravescs opened a pull request: https://github.com/apache/spark/pull/5229 [SPARK-6558] Utils.getCurrentUserName returns the full principal name instead of login name Utils.getCurrentUserName returns UserGroupInformation.getCurrentUser().getUserName() when SPARK_USER

[GitHub] spark pull request: [SPARK-6544][build] Increment Avro version fro...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5193#issuecomment-86947112 [Test build #29303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29303/consoleFull) for PR 5193 at commit

[GitHub] spark pull request: [SPARK-6544][build] Increment Avro version fro...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5193#issuecomment-86947126 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4123][Project Infra]: Show new dependen...

2015-03-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5093#discussion_r27293303 --- Diff: dev/tests/pr_new_dependencies.sh --- @@ -0,0 +1,115 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-4123][Project Infra]: Show new dependen...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5093#issuecomment-86938545 I personally favor a tests have started message quickly, yes, but I don't find it essential to print the merge status in that initial message, no. All of those results

[GitHub] spark pull request: [Project Infra] SPARK-1684: Merge script shoul...

2015-03-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5149#issuecomment-86940652 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-5654] Integrate SparkR

2015-03-27 Thread redbaron
Github user redbaron commented on a diff in the pull request: https://github.com/apache/spark/pull/5096#discussion_r27294415 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -469,6 +469,9 @@ private[spark] class ApplicationMaster(

  1   2   3   4   >