[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82504017 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/NormalEquationSolver.scala --- @@ -0,0 +1,165 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82503897 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/BLAS.scala --- @@ -244,6 +244,15 @@ private[spark] object BLAS extends Serializable {

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82503779 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -217,7 +215,7 @@ class LinearRegression @Since("1.3.0")

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82503417 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -45,34 +47,48 @@ private[ml] class WeightedLeastSquaresModel(

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82503493 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -45,34 +47,48 @@ private[ml] class WeightedLeastSquaresModel(

[GitHub] spark pull request #15394: [SPARK-17749][ML] One pass solver for Weighted Le...

2016-10-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15394#discussion_r82503487 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -45,34 +47,48 @@ private[ml] class WeightedLeastSquaresModel(

[GitHub] spark issue #15329: [SPARK-17763][SQL] JacksonParser silently parses null as...

2016-10-08 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15329 Actually, when will a user want to specify non-nullable for any json field? I am not sure if we are actually addressing the right problem. I am wondering if we should just not allow non-nullable

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66581/consoleFull)** for PR 15360 at commit

[GitHub] spark issue #15329: [SPARK-17763][SQL] JacksonParser silently parses null as...

2016-10-08 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15329 Yea. That's a good point. If we do not allow non-nullable fields, we should also let users easily convert nullability field. Let me also check with @marmbrus. --- If your project is set up for it,

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13350: [SPARK-15611][PySPARK] fix got the same sequence ...

2016-10-08 Thread ThomasLau
Github user ThomasLau closed the pull request at: https://github.com/apache/spark/pull/13350 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-10-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14963 Also @Stibbons I'm sorry the process has been so challenging and thanks for hanging in with it :) --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #15319: [SPARK-17733][SQL] InferFiltersFromConstraints ru...

2016-10-08 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/15319#discussion_r82503911 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -74,14 +74,26 @@ abstract class QueryPlan[PlanType <:

[GitHub] spark pull request #15319: [SPARK-17733][SQL] InferFiltersFromConstraints ru...

2016-10-08 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/15319#discussion_r82503891 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -74,14 +74,26 @@ abstract class QueryPlan[PlanType <:

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-08 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15382 OK, now using `Utils.resolveURI`. This means all inputs without a scheme resolve as `file:` URIs, including the default "spark-warehouse". This will continue to resolve to the local working dir by

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15382 **[Test build #66580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66580/consoleFull)** for PR 15382 at commit

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14995 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66579/ Test PASSed. ---

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14995 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15403: [SPARK-17832][SQL] TableIdentifier.quotedString c...

2016-10-08 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15403#discussion_r82506382 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/identifiers.scala --- @@ -29,12 +28,23 @@ sealed trait IdentifierWithDatabase {

[GitHub] spark issue #15353: [SPARK-17724][WebUI][Streaming] Unevaluated new lines in...

2016-10-08 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/15353 @felixcheung nice catch, you are right and a more general fix is needed then, working on it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #8384: [SPARK-8510] [CORE] [PYSPARK] NumPy matrices as values in...

2016-10-08 Thread paberline
Github user paberline commented on the issue: https://github.com/apache/spark/pull/8384 Hi @holdenk - thanks for taking the time to look at this. I understand this PR might be too esoteric for Spark core. I will close it once @mengxr @jkbradley and @davies confirm.

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-10-08 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/9 @MLnick I'm not sure I understand what you're saying. Where are we discarding cluster centers? Maybe we should say that the `initialModel` always takes precedence over `k`. So we can just

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66582/ Test PASSed. ---

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-10-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14963 Right I think the virtualenv support for PySpark in general is interesting - but its a large enough change we would need to get some substantail reviewer time dedicated to it (and I don't see that

[GitHub] spark issue #15394: [SPARK-17749][ML] One pass solver for Weighted Least Squ...

2016-10-08 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15394 Will make another indepth pass in a few days. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66582/consoleFull)** for PR 15044 at commit

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15382 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66580/ Test FAILed. ---

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15382 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.dir is r...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15382 **[Test build #66580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66580/consoleFull)** for PR 15382 at commit

[GitHub] spark issue #15403: [SPARK-17832][SQL] TableIdentifier.quotedString creates ...

2016-10-08 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15403 @jiangxb1987 This looks pretty good. What is the problem `getTable` and `getFunction`? Could you give an example? assume you are talking about the `org.apache.spark.sql.catalog.Catalog`

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66583/consoleFull)** for PR 15044 at commit

[GitHub] spark pull request #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.d...

2016-10-08 Thread avulanov
Github user avulanov commented on a diff in the pull request: https://github.com/apache/spark/pull/15382#discussion_r82507085 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -757,7 +758,10 @@ private[sql] class SQLConf extends Serializable with

[GitHub] spark issue #15097: [SPARK-17540][SparkR][Spark Core] fix SparkR array serde...

2016-10-08 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15097 @felixcheung it is the case when r-side pass an empty array and scala-side parameter type is Array[T] then there is some problem (as the TODO described in serialize.R: 166 line)...but

[GitHub] spark pull request #15097: [SPARK-17540][SparkR][Spark Core] fix SparkR arra...

2016-10-08 Thread WeichenXu123
Github user WeichenXu123 closed the pull request at: https://github.com/apache/spark/pull/15097 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15329: [SPARK-17763][SQL] JacksonParser silently parses null as...

2016-10-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15329 @yhuai Sure, I support that idea too as I think in the same way; these would be corner cases. However, just the case I thought instantly is, to use the same schema used as it is (because

[GitHub] spark issue #15329: [SPARK-17763][SQL] JacksonParser silently parses null as...

2016-10-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15329 I am willing to follow your decision if you confirm. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66582/consoleFull)** for PR 15044 at commit

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14180: [SPARK-16367][PYSPARK] Wheelhouse and VirtualEnv support

2016-10-08 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14180 I was going through the old PySpark JIRAs and there is one about an unexpected pandas failure, which could be semi-related (e.g. good virtual env support with a reasonable requirements file could

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14995 **[Test build #66579 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66579/consoleFull)** for PR 14995 at commit

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66581/consoleFull)** for PR 15360 at commit

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66581/ Test FAILed. ---

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66583/ Test PASSed. ---

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15044 **[Test build #66583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66583/consoleFull)** for PR 15044 at commit

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
GitHub user bkpathak reopened a pull request: https://github.com/apache/spark/pull/12691 [Spark-14761][SQL][WIP] Reject invalid join methods when join columns are not specified in PySpark DataFrame join. ## What changes were proposed in this pull request? In PySpark, the

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13713 @drcrallen Are you still planning to update this? It's quite a useful feature, so hoping this can get in. Also since Fine grain mode is depcreated I don't think we need to update it too. --- If

[GitHub] spark issue #13077: [SPARK-10748] [Mesos] Log error instead of crashing Spar...

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/13077 @devaraj-kavali Are you still able to update this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/12933 @hellertime Are you able to rebase? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9287: SPARK-11326: Split networking in standalone mode

2016-10-08 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/9287 This has been stale for a while, we should close this if there is no update here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #9287: SPARK-11326: Split networking in standalone mode

2016-10-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/9287 +1 for closing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66586/consoleFull)** for PR 15360 at commit

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15360 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66586/ Test PASSed. ---

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15371 **[Test build #66584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66584/consoleFull)** for PR 15371 at commit

[GitHub] spark issue #12578: [SPARK-10496][SQL] Add DataFrame cumulative sum

2016-10-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/12578 I'm going to move the discussions over to JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15371 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66584/ Test PASSed. ---

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15371 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15371: [SPARK-17816] [Core] Fix ConcurrentModificationException...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15371 **[Test build #66584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66584/consoleFull)** for PR 15371 at commit

[GitHub] spark issue #12691: [Spark-14761][SQL][WIP] Reject invalid join methods when...

2016-10-08 Thread bkpathak
Github user bkpathak commented on the issue: https://github.com/apache/spark/pull/12691 Hi @holdenk I am still interested in working on this but it looks like I pull and merged with a master branch instead of rebasing it. Can I close it and open another pull request. Or how should I

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15334 **[Test build #66585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66585/consoleFull)** for PR 15334 at commit

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15334 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66585/ Test PASSed. ---

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15334 **[Test build #66585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66585/consoleFull)** for PR 15334 at commit

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15360 **[Test build #66586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66586/consoleFull)** for PR 15360 at commit

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15334 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15371: [SPARK-17816] [Core] Fix ConcurrentModificationEx...

2016-10-08 Thread seyfe
Github user seyfe commented on a diff in the pull request: https://github.com/apache/spark/pull/15371#discussion_r82509108 --- Diff: core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala --- @@ -326,36 +324,13 @@ private[spark] object TaskMetrics extends Logging {

[GitHub] spark issue #15360: [SPARK-17073] [SQL] [FOLLOWUP] generate column-level sta...

2016-10-08 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15360 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15044: [SQL][SPARK-17490] Optimize SerializeFromObject() for a ...

2016-10-08 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15044 @hvanhovell, after my investigations, I have added code to generate `UnsafeArrayData' at two code paths. Could you please review this again? --- If your project is set up for it, you can reply to

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
GitHub user bkpathak reopened a pull request: https://github.com/apache/spark/pull/12691 [Spark-14761][SQL][WIP] Reject invalid join methods when join columns are not specified in PySpark DataFrame join. ## What changes were proposed in this pull request? In PySpark, the

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
Github user bkpathak closed the pull request at: https://github.com/apache/spark/pull/12691 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #12691: [Spark-14761][SQL][WIP] Reject invalid join metho...

2016-10-08 Thread bkpathak
Github user bkpathak closed the pull request at: https://github.com/apache/spark/pull/12691 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15404: Branch 2.0

2016-10-08 Thread yintengfei
GitHub user yintengfei opened a pull request: https://github.com/apache/spark/pull/15404 Branch 2.0 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512937 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512799 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512787 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512727 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2016-10-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15334 Saw @viirya submitted a PR for the same issue: https://github.com/apache/spark/pull/7793 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512809 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512689 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512723 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512794 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82513082 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/DecisionTreeRegressorWrapper.scala --- @@ -0,0 +1,127 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512770 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82513063 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/DecisionTreeClassifierWrapper.scala --- @@ -0,0 +1,129 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512912 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512914 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512650 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -791,4 +791,59 @@ test_that("spark.kstest", { expect_match(capture.output(stats)[1],

[GitHub] spark pull request #13690: [SPARK-15767][R][ML] Decision Tree Regression wra...

2016-10-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13690#discussion_r82512708 --- Diff: R/pkg/R/mllib.R --- @@ -1427,3 +1447,185 @@ print.summary.KSTest <- function(x, ...) { cat(summaryStr, "\n") invisible(x) }

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66587/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66587/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66587/ Test FAILed. ---

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66588/ Test PASSed. ---

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #66588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66588/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #15399: [SPARK-17819][SQL] Support default database in connectio...

2016-10-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15399 Hi, @gatorsmile . Could you review this PR when you have sometime? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

2016-10-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/14959 @vanzin @holdenk @BryanCutler PR is updated, please help review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #11211: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated t...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11211 **[Test build #66590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66590/consoleFull)** for PR 11211 at commit

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-10-08 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/14650 WIP --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #10307: [SPARK-12334][SQL][PYSPARK] Support read from multiple i...

2016-10-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10307 **[Test build #66591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66591/consoleFull)** for PR 10307 at commit

  1   2   3   >