[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-07 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662847#comment-14662847 ] Fei Wang commented on SPARK-9725: - And i not set SPARK_PREPEND_CLASSES > spark sql query

[jira] [Closed] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9731. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Standalone scheduling inco

[jira] [Resolved] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9753. Resolution: Fixed Fix Version/s: 1.5.0 > TungstenAggregate should also accept InternalRow ins

[jira] [Commented] (SPARK-9738) remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662763#comment-14662763 ] Wenchen Fan commented on SPARK-9738: [~joshrosen] sorry about the rush, I've filled in

[jira] [Updated] (SPARK-9738) remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9738: --- Description: In https://github.com/apache/spark/pull/7752 we added `FromUnsafe` to convert nexted unsa

[jira] [Updated] (SPARK-9666) ML 1.5 QA: model save/load audit

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9666: - Assignee: yuhao yang > ML 1.5 QA: model save/load audit >

[jira] [Resolved] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9754. Resolution: Fixed Fix Version/s: 1.5.0 > Remove TypeCheck in debug package >

[jira] [Commented] (SPARK-9066) Improve cartesian performance

2015-08-07 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662707#comment-14662707 ] Weizhong commented on SPARK-9066: - Yes, the root reaason is same, that is cause by scan HD

[jira] [Resolved] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9719. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8047 [https

[jira] [Resolved] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9756. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8046 [https

[jira] [Updated] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9756: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang Target Version/

[jira] [Updated] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9756: - Fix Version/s: (was: 1.5.0) > Make auxillary constructors for ML decision trees privat

[jira] [Updated] (SPARK-9670) ML 1.5 QA: Examples: Check for new APIs requiring example code

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9670: - Assignee: Ram Sriharsha > ML 1.5 QA: Examples: Check for new APIs requiring example code >

[jira] [Resolved] (SPARK-8160) Tungsten style external aggregation

2015-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8160. Resolution: Fixed > Tungsten style external aggregation > --- > >

[jira] [Resolved] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8890. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8010 [https:/

[jira] [Updated] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9719: - Assignee: Feynman Liang > spark.ml NaiveBayes doc cleanups > -

[jira] [Updated] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9719: - Shepherd: Joseph K. Bradley > spark.ml NaiveBayes doc cleanups > -

[jira] [Resolved] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9748. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8037 [https

[jira] [Updated] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9748: - Target Version/s: 1.6.0 > Centriod typo in KMeansModel > > >

[jira] [Updated] (SPARK-9748) Centriod typo in KMeansModel

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9748: - Assignee: Bertrand Dechoux > Centriod typo in KMeansModel > >

[jira] [Assigned] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9719: --- Assignee: Apache Spark > spark.ml NaiveBayes doc cleanups >

[jira] [Assigned] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9719: --- Assignee: (was: Apache Spark) > spark.ml NaiveBayes doc cleanups > --

[jira] [Commented] (SPARK-9719) spark.ml NaiveBayes doc cleanups

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662616#comment-14662616 ] Apache Spark commented on SPARK-9719: - User 'feynmanliang' has created a pull request

[jira] [Created] (SPARK-9757) Can't create persistent data source tables with decimal

2015-08-07 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9757: --- Summary: Can't create persistent data source tables with decimal Key: SPARK-9757 URL: https://issues.apache.org/jira/browse/SPARK-9757 Project: Spark I

[jira] [Updated] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9755: - Component/s: Documentation > Add method documentation to MultivariateOnlineSummarizer > --

[jira] [Updated] (SPARK-9661) ML 1.5 QA: API: Java compatibility, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9661: - Description: Check Java compatibility for MLlib for this release. Checking compatibility

[jira] [Assigned] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9756: --- Assignee: (was: Apache Spark) > Make auxillary constructors for ML decision trees private

[jira] [Commented] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662597#comment-14662597 ] Apache Spark commented on SPARK-9756: - User 'feynmanliang' has created a pull request

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662595#comment-14662595 ] Feynman Liang commented on SPARK-9660: -- SPARK-9756 > ML 1.5 QA: API: New Scala APIs,

[jira] [Assigned] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9756: --- Assignee: Apache Spark > Make auxillary constructors for ML decision trees private >

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662596#comment-14662596 ] Feynman Liang commented on SPARK-9660: -- SPARK-9756 > ML 1.5 QA: API: New Scala APIs,

[jira] [Created] (SPARK-9756) Make auxillary constructors for ML decision trees private

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9756: Summary: Make auxillary constructors for ML decision trees private Key: SPARK-9756 URL: https://issues.apache.org/jira/browse/SPARK-9756 Project: Spark Issue

[jira] [Assigned] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9755: --- Assignee: (was: Apache Spark) > Add method documentation to MultivariateOnlineSummarizer

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662583#comment-14662583 ] Feynman Liang commented on SPARK-9660: -- SPARK-9719 > ML 1.5 QA: API: New Scala APIs,

[jira] [Assigned] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9755: --- Assignee: Apache Spark > Add method documentation to MultivariateOnlineSummarizer > -

[jira] [Commented] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662582#comment-14662582 ] Apache Spark commented on SPARK-9755: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9620: --- Assignee: Apache Spark > generated UnsafeProjection does not support many columns or large ex

[jira] [Commented] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662579#comment-14662579 ] Apache Spark commented on SPARK-9620: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9620: --- Assignee: (was: Apache Spark) > generated UnsafeProjection does not support many columns

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9714: Description: This is a bug on the master branch. After creating the table ("yun" is the table name) with th

[jira] [Commented] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662569#comment-14662569 ] Feynman Liang commented on SPARK-9755: -- Working on this. > Add method documentation

[jira] [Created] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9755: Summary: Add method documentation to MultivariateOnlineSummarizer Key: SPARK-9755 URL: https://issues.apache.org/jira/browse/SPARK-9755 Project: Spark Issue

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662566#comment-14662566 ] Feynman Liang commented on SPARK-9750: -- Yep. > SparseMatrix should override equals >

[jira] [Updated] (SPARK-9375) The total number of executor(s) requested by the driver may be negative

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9375: - Assignee: KaiXinXIaoLei > The total number of executor(s) requested by the driver may be negative >

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

2015-08-07 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662558#comment-14662558 ] Sudhakar Thota commented on SPARK-9600: --- [~marmbrus] Michael, I have tested using l

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662553#comment-14662553 ] Andreas commented on SPARK-9746: I'm probably lost in translation: "here it says it counts

[jira] [Updated] (SPARK-9661) ML 1.5 QA: API: Java compatibility, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9661: - Description: Check Java compatibility for MLlib for this release. Checking compatibility

[jira] [Updated] (SPARK-9568) Spark MLlib 1.5.0 testing umbrella

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9568: - Description: h2. API * Check binary API compatibility (SPARK-9658) * Audit new public API

[jira] [Commented] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662540#comment-14662540 ] Apache Spark commented on SPARK-9754: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9754: --- Assignee: Reynold Xin (was: Apache Spark) > Remove TypeCheck in debug package >

[jira] [Assigned] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9754: --- Assignee: Apache Spark (was: Reynold Xin) > Remove TypeCheck in debug package >

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662538#comment-14662538 ] Joseph K. Bradley commented on SPARK-9750: -- [~fliang] Are you working on this? >

[jira] [Commented] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662536#comment-14662536 ] Apache Spark commented on SPARK-9750: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9750: --- Assignee: Apache Spark > SparseMatrix should override equals > --

[jira] [Assigned] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9750: --- Assignee: (was: Apache Spark) > SparseMatrix should override equals > ---

[jira] [Created] (SPARK-9754) Remove TypeCheck in debug package

2015-08-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9754: -- Summary: Remove TypeCheck in debug package Key: SPARK-9754 URL: https://issues.apache.org/jira/browse/SPARK-9754 Project: Spark Issue Type: Task Compon

[jira] [Commented] (SPARK-7454) Perf test for power iteration clustering (PIC)

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662534#comment-14662534 ] Joseph K. Bradley commented on SPARK-7454: -- [~javadba] I should have pinged you b

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9745: - Priority: Blocker (was: Critical) > Applications hangs when the last executor fails with dynamic allocati

[jira] [Updated] (SPARK-9375) The total number of executor(s) requested by the driver may be negative

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9375: - Priority: Critical (was: Major) > The total number of executor(s) requested by the driver may be negati

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662523#comment-14662523 ] Sean Owen commented on SPARK-9746: -- It does not count the number of distinct keys, nor do

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662522#comment-14662522 ] Andreas commented on SPARK-9746: Many thanks for your responsiveness and patience. I admir

[jira] [Closed] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9749. Resolution: Not A Problem > DenseMatrix equals does not account for isTransposed > -

[jira] [Comment Edited] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662520#comment-14662520 ] Feynman Liang edited comment on SPARK-9749 at 8/7/15 9:53 PM: --

[jira] [Commented] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662520#comment-14662520 ] Feynman Liang commented on SPARK-9749: -- Actually this is a non-issue, sorry. Closing.

[jira] [Resolved] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8481. -- Resolution: Fixed Issue resolved by pull request 8039 [https://github.com/apache/spark/p

[jira] [Reopened] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-8481: -- Reopening before merging version fix PR > GaussianMixtureModel predict accepting single vec

[jira] [Commented] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662513#comment-14662513 ] Apache Spark commented on SPARK-9753: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9753: --- Assignee: Yin Huai (was: Apache Spark) > TungstenAggregate should also accept InternalRow in

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662514#comment-14662514 ] Joseph K. Bradley commented on SPARK-9720: -- I like the proposal, but I don't thin

[jira] [Assigned] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9753: --- Assignee: Apache Spark (was: Yin Huai) > TungstenAggregate should also accept InternalRow in

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662510#comment-14662510 ] Andreas commented on SPARK-9746: Still the scaladoc "Count the number of elements for each

[jira] [Created] (SPARK-9753) TungstenAggregate should also accept InternalRow instead of just UnsafeRow

2015-08-07 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9753: --- Summary: TungstenAggregate should also accept InternalRow instead of just UnsafeRow Key: SPARK-9753 URL: https://issues.apache.org/jira/browse/SPARK-9753 Project: Spark

[jira] [Commented] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662506#comment-14662506 ] Apache Spark commented on SPARK-9752: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9752: --- Assignee: Reynold Xin (was: Apache Spark) > Sample operator should avoid row copying and sup

[jira] [Assigned] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9752: --- Assignee: Apache Spark (was: Reynold Xin) > Sample operator should avoid row copying and sup

[jira] [Created] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9752: -- Summary: Sample operator should avoid row copying and support UnsafeRow Key: SPARK-9752 URL: https://issues.apache.org/jira/browse/SPARK-9752 Project: Spark Iss

[jira] [Created] (SPARK-9751) Audit operators to make sure they can support UnsafeRows

2015-08-07 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9751: -- Summary: Audit operators to make sure they can support UnsafeRows Key: SPARK-9751 URL: https://issues.apache.org/jira/browse/SPARK-9751 Project: Spark Issue Type

[jira] [Commented] (SPARK-9677) Enable SQLQuerySuite."aggregation with codegen updates peak execution memory"

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662494#comment-14662494 ] Andrew Or commented on SPARK-9677: -- Resolved by https://github.com/apache/spark/pull/8015

[jira] [Closed] (SPARK-9677) Enable SQLQuerySuite."aggregation with codegen updates peak execution memory"

2015-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9677. Resolution: Fixed Fix Version/s: 1.5.0 > Enable SQLQuerySuite."aggregation with codegen updates peak

[jira] [Commented] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662475#comment-14662475 ] Feynman Liang commented on SPARK-9749: -- Working on this. > DenseMatrix equals does n

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662455#comment-14662455 ] Feynman Liang commented on SPARK-9660: -- Most documentation in [MultivariateOnlineSum

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662452#comment-14662452 ] Feynman Liang commented on SPARK-9660: -- StreamingLinearRegressionWithSGD's [setConve

[jira] [Updated] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruben Ramalho updated SPARK-9476: - Affects Version/s: (was: 1.4.1) 1.4.0 > Kafka stream loses leader after

[jira] [Comment Edited] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662446#comment-14662446 ] Ruben Ramalho edited comment on SPARK-9476 at 8/7/15 9:00 PM: --

[jira] [Comment Edited] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662446#comment-14662446 ] Ruben Ramalho edited comment on SPARK-9476 at 8/7/15 9:00 PM: --

[jira] [Comment Edited] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662446#comment-14662446 ] Ruben Ramalho edited comment on SPARK-9476 at 8/7/15 8:58 PM: --

[jira] [Commented] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-07 Thread Ruben Ramalho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662446#comment-14662446 ] Ruben Ramalho commented on SPARK-9476: -- Sorry for the late reply, I promise to keep m

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662442#comment-14662442 ] Feynman Liang commented on SPARK-9660: -- {{GradientDescent$.runMiniBatchSGD}} should e

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662440#comment-14662440 ] Sean Owen commented on SPARK-9746: -- RDDs are not maps. An RDD of (K,V) is merely a collec

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662439#comment-14662439 ] Joseph K. Bradley commented on SPARK-9660: -- I think it's OK to make this public.

[jira] [Comment Edited] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662439#comment-14662439 ] Joseph K. Bradley edited comment on SPARK-9660 at 8/7/15 8:57 PM: --

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662441#comment-14662441 ] Andreas commented on SPARK-9746: Sure I tried this with different inputs (driven by ScalaC

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662434#comment-14662434 ] Joseph K. Bradley commented on SPARK-9660: -- That's an optional parameter. If the

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662436#comment-14662436 ] Joseph K. Bradley commented on SPARK-9660: -- That was a merge bug. It's being rem

[jira] [Comment Edited] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-07 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662333#comment-14662333 ] Bertrand Dechoux edited comment on SPARK-9720 at 8/7/15 8:53 PM: ---

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-07 Thread Andreas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662430#comment-14662430 ] Andreas commented on SPARK-9746: Sorry to waste your time. But in my understanding in a P

[jira] [Commented] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662428#comment-14662428 ] Apache Spark commented on SPARK-8481: - User 'jkbradley' has created a pull request for

[jira] [Created] (SPARK-9750) SparseMatrix should override equals

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9750: Summary: SparseMatrix should override equals Key: SPARK-9750 URL: https://issues.apache.org/jira/browse/SPARK-9750 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9749) DenseMatrix equals does not account for isTransposed

2015-08-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9749: Summary: DenseMatrix equals does not account for isTransposed Key: SPARK-9749 URL: https://issues.apache.org/jira/browse/SPARK-9749 Project: Spark Issue Type

[jira] [Assigned] (SPARK-9747) Avoid starving an unsafe operator in an aggregate

2015-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9747: --- Assignee: Andrew Or (was: Apache Spark) > Avoid starving an unsafe operator in an aggregate

  1   2   3   >