[jira] [Resolved] (SPARK-9667) Remove SparkSqlSerializer2 in favor of Unsafe exchange

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9667. Resolution: Fixed Fix Version/s: 1.5.0 Remove SparkSqlSerializer2 in favor of Unsafe

[jira] [Comment Edited] (SPARK-9744) Add Java RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662188#comment-14662188 ] Jerry Z edited comment on SPARK-9744 at 8/7/15 6:14 PM: Let me

[jira] [Commented] (SPARK-9744) Add Java RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662188#comment-14662188 ] Jerry Z commented on SPARK-9744: Let me know if I'm missing/doing more work than

[jira] [Updated] (SPARK-9709) Avoid starving an unsafe operator in a sort

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9709: - Priority: Blocker (was: Critical) Avoid starving an unsafe operator in a sort

[jira] [Updated] (SPARK-9693) Reserve a page in all unsafe operators to avoid starving an operator

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Priority: Blocker (was: Critical) Reserve a page in all unsafe operators to avoid starving an operator

[jira] [Created] (SPARK-9747) Avoid starving an unsafe operator in an aggregate

2015-08-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-9747: Summary: Avoid starving an unsafe operator in an aggregate Key: SPARK-9747 URL: https://issues.apache.org/jira/browse/SPARK-9747 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9744) Add Java RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Summary: Add Java RDD method to map with lag and lead (was: Add RDD method to map with lag and lead) Add

[jira] [Updated] (SPARK-8382) Improve Analysis Unit test framework

2015-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8382: Assignee: Wenchen Fan Improve Analysis Unit test framework

[jira] [Resolved] (SPARK-8382) Improve Analysis Unit test framework

2015-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8382. - Resolution: Fixed Fix Version/s: 1.5.0 Improve Analysis Unit test framework

[jira] [Created] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Bertrand Dechoux (JIRA)
Bertrand Dechoux created SPARK-9748: --- Summary: Centriod typo in KMeansModel Key: SPARK-9748 URL: https://issues.apache.org/jira/browse/SPARK-9748 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662269#comment-14662269 ] Bertrand Dechoux commented on SPARK-9748: - Pull request done :

[jira] [Commented] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662268#comment-14662268 ] Apache Spark commented on SPARK-9748: - User 'BertrandDechoux' has created a pull

[jira] [Updated] (SPARK-9647) MLlib + SparkR integration for 1.6

2015-08-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9647: - Priority: Critical (was: Major) MLlib + SparkR integration for 1.6

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Alex Angelini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Angelini updated SPARK-9745: - Description: When a job has only a single executor remaining and that executor dies (due to

[jira] [Commented] (SPARK-6392) [SQL]class not found exception thows when `add jar` use spark cli

2015-08-07 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662189#comment-14662189 ] Jonathan Kelly commented on SPARK-6392: --- Are you sure this is fixed by

[jira] [Updated] (SPARK-7252) Add support for creating new Hive and HBase delegation tokens

2015-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-7252: -- Affects Version/s: (was: 1.3.1) 1.5.0 Add support for creating new

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

2015-08-07 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662227#comment-14662227 ] Zhan Zhang commented on SPARK-5111: --- Since hive upgrade is done. This jira is not valid

[jira] [Resolved] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9746. -- Resolution: Not A Problem This should start as a question on user@.

[jira] [Updated] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Summary: Add RDD method to map with lag and lead (was: Add Java RDD method to map with lag and lead) Add

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662117#comment-14662117 ] Steve Loughran commented on SPARK-6882: --- Spark 1.5 will use Hive 1.2.1; this problem

[jira] [Created] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
Andreas created SPARK-9746: -- Summary: PairRDDFunctions.countByKey: values/counts always 1 Key: SPARK-9746 URL: https://issues.apache.org/jira/browse/SPARK-9746 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662248#comment-14662248 ] Bertrand Dechoux commented on SPARK-9720: - I might not understand but isn't it

[jira] [Commented] (SPARK-9742) NullPointerException when using --packages

2015-08-07 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662260#comment-14662260 ] Burak Yavuz commented on SPARK-9742: Did the behavior of Option's change for some

[jira] [Commented] (SPARK-9658) ML 1.5 QA: API: Binary incompatible changes

2015-08-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662086#comment-14662086 ] Xiangrui Meng commented on SPARK-9658: -- 1. Let's maintain binary compatibility. LDA

[jira] [Resolved] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9614. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.5.0 I'd like to mark this as

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Alex Angelini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Angelini updated SPARK-9745: - Description: When a job has only a single executor remaining and that executor dies (due to

[jira] [Updated] (SPARK-9744) Add Java RDD method to map with lag and lead

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9744: - Priority: Minor (was: Major) This sounds a bit like a windowing function. This is something you can do

[jira] [Commented] (SPARK-9667) Remove SparkSqlSerializer2 in favor of Unsafe exchange

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662193#comment-14662193 ] Apache Spark commented on SPARK-9667: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9745: -- Priority: Critical (was: Major) Applications hangs when the last executor fails with dynamic

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662253#comment-14662253 ] Joseph K. Bradley commented on SPARK-9720: -- Good point about the default

[jira] [Updated] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9720: - Description: It would be nice to print the UID (instance name) in toString methods.

[jira] [Resolved] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

2015-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-5111. --- Resolution: Done Fix Version/s: 1.5.0 HiveContext and Thriftserver cannot work in

[jira] [Updated] (SPARK-9673) Use unbiased standard deviation in DataFrame.describe

2015-08-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9673: - Assignee: Burak Yavuz Use unbiased standard deviation in DataFrame.describe

[jira] [Commented] (SPARK-9701) allow not automatically using HiveContext with spark-shell when hive support built in

2015-08-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662115#comment-14662115 ] Davies Liu commented on SPARK-9701: --- [~lian cheng] [~yhuai] Should we target this for

[jira] [Updated] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9731: - Assignee: Carson Wang Standalone scheduling incorrect cores if spark.executor.cores is not set

[jira] [Created] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Alex Angelini (JIRA)
Alex Angelini created SPARK-9745: Summary: Applications hangs when the last executor fails with dynamic allocation Key: SPARK-9745 URL: https://issues.apache.org/jira/browse/SPARK-9745 Project: Spark

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9745: -- Assignee: Andrew Or Applications hangs when the last executor fails with dynamic allocation

[jira] [Commented] (SPARK-9744) Add Java RDD method to map with lag and lead

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662233#comment-14662233 ] Sean Owen commented on SPARK-9744: -- Yeah that's the idea. It works though is potentially

[jira] [Assigned] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9748: --- Assignee: Apache Spark Centriod typo in KMeansModel

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662270#comment-14662270 ] Feynman Liang commented on SPARK-9660: --

[jira] [Assigned] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9748: --- Assignee: (was: Apache Spark) Centriod typo in KMeansModel

[jira] [Commented] (SPARK-9744) Add Java RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662267#comment-14662267 ] Jerry Z commented on SPARK-9744: Not sure what you mean by Why just the Java RDD?. Also,

[jira] [Issue Comment Deleted] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bertrand Dechoux updated SPARK-9748: Comment: was deleted (was: Pull request done : https://github.com/apache/spark/pull/8037)

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662317#comment-14662317 ] Feynman Liang commented on SPARK-9660: -- Should [RandomForestClassificationModel's aux

[jira] [Resolved] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9746. -- Resolution: Not A Problem Do not reopen an issue unless it's clear that the original reason it was

[jira] [Closed] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-9746. PairRDDFunctions.countByKey: values/counts always 1 ---

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662352#comment-14662352 ] Joseph K. Bradley commented on SPARK-9660: -- I do want it public at some point,

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662364#comment-14662364 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 8:16 PM: --

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662374#comment-14662374 ] Feynman Liang commented on SPARK-9660: -- {{SVMModel}} missing short descriptions for

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662382#comment-14662382 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 8:30 PM: --

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662382#comment-14662382 ] Feynman Liang commented on SPARK-9660: -- {{GaussianMixtureModel.predict(Vector)}} has

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662381#comment-14662381 ] Andreas commented on SPARK-9746: Sorry, but it doesn't count anything, the values of the

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662383#comment-14662383 ] Sean Owen commented on SPARK-9746: -- Yes. That is what it means to count the # of

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662439#comment-14662439 ] Joseph K. Bradley commented on SPARK-9660: -- I think it's OK to make this public.

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662434#comment-14662434 ] Joseph K. Bradley commented on SPARK-9660: -- That's an optional parameter. If

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662436#comment-14662436 ] Joseph K. Bradley commented on SPARK-9660: -- That was a merge bug. It's being

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662439#comment-14662439 ] Joseph K. Bradley edited comment on SPARK-9660 at 8/7/15 8:57 PM:

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662441#comment-14662441 ] Andreas commented on SPARK-9746: Sure I tried this with different inputs (driven by

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662300#comment-14662300 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662295#comment-14662295 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662296#comment-14662296 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662299#comment-14662299 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662301#comment-14662301 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Issue Comment Deleted] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Comment: was deleted (was: Fixed! Sorry didn't know you were referring to the title. So I think for

[jira] [Issue Comment Deleted] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Comment: was deleted (was: Fixed! Sorry didn't know you were referring to the title. So I think for

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662297#comment-14662297 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Issue Comment Deleted] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Comment: was deleted (was: Fixed! Sorry didn't know you were referring to the title. So I think for

[jira] [Issue Comment Deleted] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Comment: was deleted (was: Fixed! Sorry didn't know you were referring to the title. So I think for

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662354#comment-14662354 ] Feynman Liang commented on SPARK-9660: -- {{CrossValidatorModel}}'s {{avgMetrics}} and

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662355#comment-14662355 ] Joseph K. Bradley commented on SPARK-9660: -- I believe we're adding the threshold

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662398#comment-14662398 ] Sean Owen commented on SPARK-9746: -- No, that's wrong. The *input* are arbitrary types K

[jira] [Updated] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruben Ramalho updated SPARK-9476: - Affects Version/s: (was: 1.4.1) 1.4.0 Kafka stream loses leader after

[jira] [Comment Edited] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662296#comment-14662296 ] Jerry Z edited comment on SPARK-9744 at 8/7/15 7:20 PM: Fixed!

[jira] [Comment Edited] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662296#comment-14662296 ] Jerry Z edited comment on SPARK-9744 at 8/7/15 7:19 PM: Fixed!

[jira] [Commented] (SPARK-9678) HTTP request to BlockManager port yields exception

2015-08-07 Thread Aseem Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662321#comment-14662321 ] Aseem Bansal commented on SPARK-9678: - I understand. Just thought to mention that.

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662333#comment-14662333 ] Bertrand Dechoux commented on SPARK-9720: - I could take care of it. Here is the

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662347#comment-14662347 ] Feynman Liang commented on SPARK-9660: -- In Decision Tree models, {{numFeatures}} is

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662348#comment-14662348 ] Sean Owen commented on SPARK-9746: -- It counts the number of entries whose key is K, for

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662390#comment-14662390 ] Andreas commented on SPARK-9746: Btw the value cannot be a ham sandwich: according to

[jira] [Resolved] (SPARK-9733) Improve explain message for data source scan node

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9733. Resolution: Fixed Fix Version/s: 1.5.0 Improve explain message for data source scan node

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662410#comment-14662410 ] Feynman Liang commented on SPARK-9660: -- [Word2VecModel aux

[jira] [Created] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9750: Summary: SparseMatrix should override equals Key: SPARK-9750 URL: https://issues.apache.org/jira/browse/SPARK-9750 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662428#comment-14662428 ] Apache Spark commented on SPARK-8481: - User 'jkbradley' has created a pull request for

[jira] [Comment Edited] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662446#comment-14662446 ] Ruben Ramalho edited comment on SPARK-9476 at 8/7/15 9:00 PM: --

[jira] [Comment Edited] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662446#comment-14662446 ] Ruben Ramalho edited comment on SPARK-9476 at 8/7/15 9:00 PM: --

[jira] [Commented] (SPARK-4176) Support decimals with precision 18 in Parquet

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661764#comment-14661764 ] Apache Spark commented on SPARK-4176: - User 'liancheng' has created a pull request for

<    1   2   3