[jira] [Updated] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9719: - Shepherd: Joseph K. Bradley spark.ml NaiveBayes doc cleanups

[jira] [Updated] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9719: - Assignee: Feynman Liang spark.ml NaiveBayes doc cleanups

[jira] [Resolved] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8890. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8010

[jira] [Resolved] (SPARK-8160) Tungsten style external aggregation

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8160. Resolution: Fixed Tungsten style external aggregation ---

[jira] [Updated] (SPARK-9670) ML 1.5 QA: Examples: Check for new APIs requiring example code

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9670: - Assignee: Ram Sriharsha ML 1.5 QA: Examples: Check for new APIs requiring example code

[jira] [Updated] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9756: - Fix Version/s: (was: 1.5.0) Make auxillary constructors for ML decision trees

[jira] [Updated] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9756: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang Target

[jira] [Resolved] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9756. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8046

[jira] [Resolved] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9719. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8047

[jira] [Commented] (SPARK-9066) Improve cartesian performance

2015-08-07 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662707#comment-14662707 ] Weizhong commented on SPARK-9066: - Yes, the root reaason is same, that is cause by scan

[jira] [Resolved] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9754. Resolution: Fixed Fix Version/s: 1.5.0 Remove TypeCheck in debug package

[jira] [Updated] (SPARK-9666) ML 1.5 QA: model save/load audit

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9666: - Assignee: yuhao yang ML 1.5 QA: model save/load audit

[jira] [Updated] (SPARK-9738) remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9738: --- Description: In https://github.com/apache/spark/pull/7752 we added `FromUnsafe` to convert nexted

[jira] [Commented] (SPARK-9738) remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662763#comment-14662763 ] Wenchen Fan commented on SPARK-9738: [~joshrosen] sorry about the rush, I've filled in

[jira] [Resolved] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9753. Resolution: Fixed Fix Version/s: 1.5.0 TungstenAggregate should also accept InternalRow

[jira] [Resolved] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9748. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8037

[jira] [Updated] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9748: - Target Version/s: 1.6.0 Centriod typo in KMeansModel

[jira] [Updated] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9748: - Assignee: Bertrand Dechoux Centriod typo in KMeansModel

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662298#comment-14662298 ] Jerry Z commented on SPARK-9744: Fixed! Sorry didn't know you were referring to the title.

[jira] [Issue Comment Deleted] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Comment: was deleted (was: Fixed! Sorry didn't know you were referring to the title. So I think for

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662303#comment-14662303 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 7:23 PM: --

[jira] [Issue Comment Deleted] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-07 Thread Jerry Z (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Z updated SPARK-9744: --- Comment: was deleted (was: Fixed! Sorry didn't know you were referring to the title. So I think for

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662303#comment-14662303 ] Feynman Liang commented on SPARK-9660: -- Logistic regression [only supports binary

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662317#comment-14662317 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 7:58 PM: --

[jira] [Comment Edited] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662333#comment-14662333 ] Bertrand Dechoux edited comment on SPARK-9720 at 8/7/15 7:59 PM:

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662360#comment-14662360 ] Andreas commented on SPARK-9746: May be I'm to dumb: but the count for each key is always

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662367#comment-14662367 ] Feynman Liang commented on SPARK-9660: -- {{LogisticRegressionModel.toString()}}

[jira] [Created] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9749: Summary: DenseMatrix equals does not account for isTransposed Key: SPARK-9749 URL: https://issues.apache.org/jira/browse/SPARK-9749 Project: Spark Issue

[jira] [Created] (SPARK-9740) first/last aggregate NULL behavior

2015-08-07 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-9740: Summary: first/last aggregate NULL behavior Key: SPARK-9740 URL: https://issues.apache.org/jira/browse/SPARK-9740 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-07 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated SPARK-9340: -- Affects Version/s: 1.3.0 ParquetTypeConverter incorrectly handling of repeated types results in schema

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661830#comment-14661830 ] Apache Spark commented on SPARK-9340: - User 'dguy' has created a pull request for this

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-07 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661831#comment-14661831 ] Damian Guy commented on SPARK-9340: --- I created a pull request against the 1.3 branch

[jira] [Assigned] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9340: --- Assignee: (was: Apache Spark) ParquetTypeConverter incorrectly handling of repeated

[jira] [Assigned] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9340: --- Assignee: Apache Spark ParquetTypeConverter incorrectly handling of repeated types results

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2015-08-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661859#comment-14661859 ] Herman van Hovell commented on SPARK-9740: -- BTW: I encountered this while doing

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662317#comment-14662317 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 8:04 PM: --

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662317#comment-14662317 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 8:04 PM: --

[jira] [Comment Edited] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662341#comment-14662341 ] Andreas edited comment on SPARK-9746 at 8/7/15 8:04 PM: Sorry, but

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662356#comment-14662356 ] Joseph K. Bradley commented on SPARK-9660: -- Sure, sounds good. (same as for

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662358#comment-14662358 ] Joseph K. Bradley commented on SPARK-9660: -- I want to add it as public for all

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662378#comment-14662378 ] Feynman Liang commented on SPARK-9660: -- [~josephkb] Don't users have to provide

[jira] [Comment Edited] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662333#comment-14662333 ] Bertrand Dechoux edited comment on SPARK-9720 at 8/7/15 8:41 PM:

[jira] [Comment Edited] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662333#comment-14662333 ] Bertrand Dechoux edited comment on SPARK-9720 at 8/7/15 8:53 PM:

[jira] [Commented] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662446#comment-14662446 ] Ruben Ramalho commented on SPARK-9476: -- Sorry for the late reply, I promise to keep

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662440#comment-14662440 ] Sean Owen commented on SPARK-9746: -- RDDs are not maps. An RDD of (K,V) is merely a

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662442#comment-14662442 ] Feynman Liang commented on SPARK-9660: -- {{GradientDescent$.runMiniBatchSGD}} should

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662455#comment-14662455 ] Feynman Liang commented on SPARK-9660: -- Most documentation in

[jira] [Commented] (SPARK-9677) Enable SQLQuerySuite.aggregation with codegen updates peak execution memory

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662494#comment-14662494 ] Andrew Or commented on SPARK-9677: -- Resolved by https://github.com/apache/spark/pull/8015

[jira] [Closed] (SPARK-9677) Enable SQLQuerySuite.aggregation with codegen updates peak execution memory

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9677. Resolution: Fixed Fix Version/s: 1.5.0 Enable SQLQuerySuite.aggregation with codegen updates peak

[jira] [Reopened] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-8481: -- Reopening before merging version fix PR GaussianMixtureModel predict accepting single

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662522#comment-14662522 ] Andreas commented on SPARK-9746: Many thanks for your responsiveness and patience. I

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9745: - Priority: Blocker (was: Critical) Applications hangs when the last executor fails with dynamic

[jira] [Updated] (SPARK-9375) The total number of executor(s) requested by the driver may be negative

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9375: - Priority: Critical (was: Major) The total number of executor(s) requested by the driver may be

[jira] [Assigned] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9754: --- Assignee: Apache Spark (was: Reynold Xin) Remove TypeCheck in debug package

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662538#comment-14662538 ] Joseph K. Bradley commented on SPARK-9750: -- [~fliang] Are you working on this?

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662536#comment-14662536 ] Apache Spark commented on SPARK-9750: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9750: --- Assignee: Apache Spark SparseMatrix should override equals

[jira] [Assigned] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9750: --- Assignee: (was: Apache Spark) SparseMatrix should override equals

[jira] [Created] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9754: -- Summary: Remove TypeCheck in debug package Key: SPARK-9754 URL: https://issues.apache.org/jira/browse/SPARK-9754 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-9568) Spark MLlib 1.5.0 testing umbrella

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9568: - Description: h2. API * Check binary API compatibility (SPARK-9658) * Audit new public

[jira] [Created] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9755: Summary: Add method documentation to MultivariateOnlineSummarizer Key: SPARK-9755 URL: https://issues.apache.org/jira/browse/SPARK-9755 Project: Spark Issue

[jira] [Commented] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662569#comment-14662569 ] Feynman Liang commented on SPARK-9755: -- Working on this. Add method documentation

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9714: Description: This is a bug on the master branch. After creating the table (yun is the table name) with the

[jira] [Created] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9756: Summary: Make auxillary constructors for ML decision trees private Key: SPARK-9756 URL: https://issues.apache.org/jira/browse/SPARK-9756 Project: Spark

[jira] [Created] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9752: -- Summary: Sample operator should avoid row copying and support UnsafeRow Key: SPARK-9752 URL: https://issues.apache.org/jira/browse/SPARK-9752 Project: Spark

[jira] [Created] (SPARK-9751) Audit operators to make sure they can support UnsafeRows

2015-08-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9751: -- Summary: Audit operators to make sure they can support UnsafeRows Key: SPARK-9751 URL: https://issues.apache.org/jira/browse/SPARK-9751 Project: Spark Issue

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662510#comment-14662510 ] Andreas commented on SPARK-9746: Still the scaladoc Count the number of elements for each

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662514#comment-14662514 ] Joseph K. Bradley commented on SPARK-9720: -- I like the proposal, but I don't

[jira] [Assigned] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9753: --- Assignee: Yin Huai (was: Apache Spark) TungstenAggregate should also accept InternalRow

[jira] [Assigned] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9753: --- Assignee: Apache Spark (was: Yin Huai) TungstenAggregate should also accept InternalRow

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662523#comment-14662523 ] Sean Owen commented on SPARK-9746: -- It does not count the number of distinct keys, nor

[jira] [Commented] (SPARK-7454) Perf test for power iteration clustering (PIC)

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662534#comment-14662534 ] Joseph K. Bradley commented on SPARK-7454: -- [~javadba] I should have pinged you

[jira] [Commented] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662540#comment-14662540 ] Apache Spark commented on SPARK-9754: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9754: --- Assignee: Reynold Xin (was: Apache Spark) Remove TypeCheck in debug package

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662566#comment-14662566 ] Feynman Liang commented on SPARK-9750: -- Yep. SparseMatrix should override equals

[jira] [Assigned] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9620: --- Assignee: (was: Apache Spark) generated UnsafeProjection does not support many columns

[jira] [Assigned] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9620: --- Assignee: Apache Spark generated UnsafeProjection does not support many columns or large

[jira] [Commented] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662579#comment-14662579 ] Apache Spark commented on SPARK-9620: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-9757) Can't create persistent data source tables with decimal

2015-08-07 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9757: --- Summary: Can't create persistent data source tables with decimal Key: SPARK-9757 URL: https://issues.apache.org/jira/browse/SPARK-9757 Project: Spark

[jira] [Assigned] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9719: --- Assignee: (was: Apache Spark) spark.ml NaiveBayes doc cleanups

[jira] [Commented] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662616#comment-14662616 ] Apache Spark commented on SPARK-9719: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9719: --- Assignee: Apache Spark spark.ml NaiveBayes doc cleanups

[jira] [Reopened] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andreas reopened SPARK-9746: Sorry, but I don't agree. cntxt..parallelize(List ((a, 1), (a, 2))).groupBy(_._1).countByKey() returns 'Map(a

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662364#comment-14662364 ] Feynman Liang commented on SPARK-9660: -- {{LogisticRegressionModel$.load}} missing

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662374#comment-14662374 ] Feynman Liang edited comment on SPARK-9660 at 8/7/15 8:26 PM: --

[jira] [Commented] (SPARK-9738) remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662403#comment-14662403 ] Josh Rosen commented on SPARK-9738: --- [~davies], [~cloud_fan], [~rxin], should this JIRA

[jira] [Assigned] (SPARK-9747) Avoid starving an unsafe operator in an aggregate

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9747: --- Assignee: Andrew Or (was: Apache Spark) Avoid starving an unsafe operator in an aggregate

[jira] [Assigned] (SPARK-9747) Avoid starving an unsafe operator in an aggregate

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9747: --- Assignee: Apache Spark (was: Andrew Or) Avoid starving an unsafe operator in an aggregate

[jira] [Commented] (SPARK-9747) Avoid starving an unsafe operator in an aggregate

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662413#comment-14662413 ] Apache Spark commented on SPARK-9747: - User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662430#comment-14662430 ] Andreas commented on SPARK-9746: Sorry to waste your time. But in my understanding in a

[jira] [Comment Edited] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662446#comment-14662446 ] Ruben Ramalho edited comment on SPARK-9476 at 8/7/15 8:58 PM: --

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662452#comment-14662452 ] Feynman Liang commented on SPARK-9660: -- StreamingLinearRegressionWithSGD's

[jira] [Commented] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662475#comment-14662475 ] Feynman Liang commented on SPARK-9749: -- Working on this. DenseMatrix equals does

[jira] [Created] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9753: --- Summary: TungstenAggregate should also accept InternalRow instead of just UnsafeRow Key: SPARK-9753 URL: https://issues.apache.org/jira/browse/SPARK-9753 Project: Spark

[jira] [Assigned] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9752: --- Assignee: Apache Spark (was: Reynold Xin) Sample operator should avoid row copying and

[jira] [Assigned] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9752: --- Assignee: Reynold Xin (was: Apache Spark) Sample operator should avoid row copying and

[jira] [Commented] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662506#comment-14662506 ] Apache Spark commented on SPARK-9752: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662513#comment-14662513 ] Apache Spark commented on SPARK-9753: - User 'yhuai' has created a pull request for

[jira] [Resolved] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8481. -- Resolution: Fixed Issue resolved by pull request 8039

[jira] [Closed] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9749. Resolution: Not A Problem DenseMatrix equals does not account for isTransposed

  1   2   3   >