[jira] [Commented] (SPARK-10110) StringIndexer lacks of parameter handleInvalid.

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702966#comment-14702966 ] Apache Spark commented on SPARK-10110: -- User 'Lewuathe' has created a pull request

[jira] [Assigned] (SPARK-10110) StringIndexer lacks of parameter handleInvalid.

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10110: Assignee: Apache Spark StringIndexer lacks of parameter handleInvalid.

[jira] [Assigned] (SPARK-10110) StringIndexer lacks of parameter handleInvalid.

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10110: Assignee: (was: Apache Spark) StringIndexer lacks of parameter handleInvalid.

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2015-08-19 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703025#comment-14703025 ] Thomas Demoor commented on SPARK-7481: -- [~srowen] and [~pc...@uowmail.edu.au]: with

[jira] [Assigned] (SPARK-10111) StringIndexerModel lacks of method labels

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10111: Assignee: (was: Apache Spark) StringIndexerModel lacks of method labels

[jira] [Assigned] (SPARK-10111) StringIndexerModel lacks of method labels

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10111: Assignee: Apache Spark StringIndexerModel lacks of method labels

[jira] [Commented] (SPARK-10111) StringIndexerModel lacks of method labels

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703019#comment-14703019 ] Apache Spark commented on SPARK-10111: -- User 'Lewuathe' has created a pull request

[jira] [Updated] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Abhinav Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Mishra updated SPARK-10112: --- Description: I have this piece of code which works fine on one machine but when I run this

[jira] [Resolved] (SPARK-8949) Remove references to preferredNodeLocalityData in javadoc and print warning when used

2015-08-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8949. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7874

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-08-19 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702917#comment-14702917 ] Virgil Palanciuc commented on SPARK-10109: -- Full version details (if it

[jira] [Assigned] (SPARK-10108) Add @since tags to mllib.feature

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10108: Assignee: (was: Apache Spark) Add @since tags to mllib.feature

[jira] [Commented] (SPARK-10108) Add @since tags to mllib.feature

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702880#comment-14702880 ] Apache Spark commented on SPARK-10108: -- User 'MechCoder' has created a pull request

[jira] [Created] (SPARK-10109) NPE when saving Parquet To HDFS

2015-08-19 Thread Virgil Palanciuc (JIRA)
Virgil Palanciuc created SPARK-10109: Summary: NPE when saving Parquet To HDFS Key: SPARK-10109 URL: https://issues.apache.org/jira/browse/SPARK-10109 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-10108) Add @since tags to mllib.feature

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10108: Assignee: Apache Spark Add @since tags to mllib.feature

[jira] [Created] (SPARK-10110) StringIndexer lacks of parameter handleInvalid.

2015-08-19 Thread Kai Sasaki (JIRA)
Kai Sasaki created SPARK-10110: -- Summary: StringIndexer lacks of parameter handleInvalid. Key: SPARK-10110 URL: https://issues.apache.org/jira/browse/SPARK-10110 Project: Spark Issue Type:

[jira] [Created] (SPARK-10113) Support for unsigned Parquet logical types

2015-08-19 Thread Jordan Thomas (JIRA)
Jordan Thomas created SPARK-10113: - Summary: Support for unsigned Parquet logical types Key: SPARK-10113 URL: https://issues.apache.org/jira/browse/SPARK-10113 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8949) Remove references to preferredNodeLocalityData in javadoc and print warning when used

2015-08-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8949: - Assignee: Han JU Remove references to preferredNodeLocalityData in javadoc and print warning when used

[jira] [Created] (SPARK-10111) StringIndexerModel lacks of method labels

2015-08-19 Thread Kai Sasaki (JIRA)
Kai Sasaki created SPARK-10111: -- Summary: StringIndexerModel lacks of method labels Key: SPARK-10111 URL: https://issues.apache.org/jira/browse/SPARK-10111 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10111) StringIndexerModel lacks of method labels

2015-08-19 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated SPARK-10111: --- Description: Missing {{labels}} property of {{StringIndexerModel}} in pyspark. (was: Missing

[jira] [Created] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Abhinav Mishra (JIRA)
Abhinav Mishra created SPARK-10112: -- Summary: ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another Key: SPARK-10112 URL:

[jira] [Commented] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Abhinav Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703084#comment-14703084 ] Abhinav Mishra commented on SPARK-10112: I am doing an assert on

[jira] [Commented] (SPARK-9812) Test all new Python API examples

2015-08-19 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703232#comment-14703232 ] Shixiong Zhu commented on SPARK-9812: - queue_stream.py failed because it uses `xrange`

[jira] [Commented] (SPARK-7992) Hide private classes/objects in in generated Java API doc

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703246#comment-14703246 ] Xiangrui Meng commented on SPARK-7992: -- We need to update the official genjavadoc to

[jira] [Commented] (SPARK-10027) Add Python API missing methods for ml.feature

2015-08-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703127#comment-14703127 ] Yanbo Liang commented on SPARK-10027: - [~lewuathe] I'm sorry that I have worked on

[jira] [Updated] (SPARK-9848) Add @Since annotation to new public APIs in 1.5

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9848: - Summary: Add @Since annotation to new public APIs in 1.5 (was: Add @since tag to new public APIs

[jira] [Updated] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Abhinav Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Mishra updated SPARK-10112: --- Description: I have this piece of code which works fine on one machine but when I run this

[jira] [Commented] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Abhinav Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703147#comment-14703147 ] Abhinav Mishra commented on SPARK-10112: I have put the assertion before the line

[jira] [Updated] (SPARK-10115) MLlib ALS training fails with java.lang.ClassCastException

2015-08-19 Thread Michal Laclavik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Laclavik updated SPARK-10115: Description: I am running ALS collaborative filtering training on data which looks as

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-08-19 Thread Aram Mkrtchyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703164#comment-14703164 ] Aram Mkrtchyan commented on SPARK-5480: --- According to our investigation Spark stores

[jira] [Commented] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703139#comment-14703139 ] Sean Owen commented on SPARK-10112: --- How do you know the assertion succeeds if it

[jira] [Comment Edited] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-08-19 Thread Aram Mkrtchyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703164#comment-14703164 ] Aram Mkrtchyan edited comment on SPARK-5480 at 8/19/15 3:21 PM:

[jira] [Commented] (SPARK-10023) Unified DecisionTreeParams checkpointInterval between Scala and Python API.

2015-08-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703179#comment-14703179 ] Yanbo Liang commented on SPARK-10023: - [~josephkb] I have note the inconsistent

[jira] [Commented] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Abhinav Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703234#comment-14703234 ] Abhinav Mishra commented on SPARK-10112: theres only 1 partition in both the

[jira] [Assigned] (SPARK-9812) Test all new Python API examples

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9812: --- Assignee: Apache Spark (was: Shixiong Zhu) Test all new Python API examples

[jira] [Commented] (SPARK-9944) hive.metastore.warehouse.dir is not respected

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703104#comment-14703104 ] Yin Huai commented on SPARK-9944: - where did you put your {{hive-site.xml}}? Also, in

[jira] [Commented] (SPARK-10027) Add Python API missing methods for ml.feature

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703137#comment-14703137 ] Apache Spark commented on SPARK-10027: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-10027) Add Python API missing methods for ml.feature

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10027: Assignee: Apache Spark Add Python API missing methods for ml.feature

[jira] [Assigned] (SPARK-10027) Add Python API missing methods for ml.feature

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10027: Assignee: (was: Apache Spark) Add Python API missing methods for ml.feature

[jira] [Updated] (SPARK-10104) Consolidate different forms of table identifiers

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10104: - Description: Right now, we have QualifiedTableName, TableIdentifier, and Seq[String] to represent table

[jira] [Commented] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703229#comment-14703229 ] Sean Owen commented on SPARK-10112: --- Do the partitions have the same number of elements

[jira] [Commented] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703267#comment-14703267 ] Herman van Hovell commented on SPARK-9357: -- {{JoinedRow}} adds branches and a

[jira] [Updated] (SPARK-10104) Consolidate different forms of table identifiers

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10104: - Description: Right now, we have QualifiedTableName, TableIdentifier, and Seq[String] to represent table

[jira] [Created] (SPARK-10117) Implement SQL data source API for reading LIBSVM data

2015-08-19 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10117: - Summary: Implement SQL data source API for reading LIBSVM data Key: SPARK-10117 URL: https://issues.apache.org/jira/browse/SPARK-10117 Project: Spark

[jira] [Commented] (SPARK-9848) Add @Since annotation to new public APIs in 1.5

2015-08-19 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703133#comment-14703133 ] Manoj Kumar commented on SPARK-9848: Do we want to tag spark.ml in this release as

[jira] [Created] (SPARK-10116) XORShiftRandom should generate uniform seeds

2015-08-19 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-10116: Summary: XORShiftRandom should generate uniform seeds Key: SPARK-10116 URL: https://issues.apache.org/jira/browse/SPARK-10116 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9944) hive.metastore.warehouse.dir is not respected

2015-08-19 Thread Manku Timma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703098#comment-14703098 ] Manku Timma commented on SPARK-9944: Let me describe what I tried out: 1. set the

[jira] [Assigned] (SPARK-10114) Add optional getters to the spark.sql.Row

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10114: Assignee: (was: Apache Spark) Add optional getters to the spark.sql.Row

[jira] [Commented] (SPARK-10114) Add optional getters to the spark.sql.Row

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703122#comment-14703122 ] Apache Spark commented on SPARK-10114: -- User 'crakjie' has created a pull request

[jira] [Updated] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9895: - Shepherd: Xiangrui Meng User Guide for RFormula Feature Transformer

[jira] [Assigned] (SPARK-10114) Add optional getters to the spark.sql.Row

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10114: Assignee: Apache Spark Add optional getters to the spark.sql.Row

[jira] [Commented] (SPARK-9848) Add @Since annotation to new public APIs in 1.5

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703129#comment-14703129 ] Xiangrui Meng commented on SPARK-9848: -- Well, there are many under `spark.ml`. Add

[jira] [Updated] (SPARK-10115) MLlib ALS training fails with java.lang.ClassCastException

2015-08-19 Thread Michal Laclavik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Laclavik updated SPARK-10115: Description: I am running ALS collaborative filtering training on data which looks as

[jira] [Created] (SPARK-10115) MLlib ALS training fails with java.lang.ClassCastException

2015-08-19 Thread Michal Laclavik (JIRA)
Michal Laclavik created SPARK-10115: --- Summary: MLlib ALS training fails with java.lang.ClassCastException Key: SPARK-10115 URL: https://issues.apache.org/jira/browse/SPARK-10115 Project: Spark

[jira] [Updated] (SPARK-10115) MLlib ALS training fails with java.lang.ClassCastException

2015-08-19 Thread Michal Laclavik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Laclavik updated SPARK-10115: Description: I am running ALS collaborative filtering training on data which looks as

[jira] [Assigned] (SPARK-9812) Test all new Python API examples

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9812: --- Assignee: Shixiong Zhu (was: Apache Spark) Test all new Python API examples

[jira] [Commented] (SPARK-9812) Test all new Python API examples

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703244#comment-14703244 ] Apache Spark commented on SPARK-9812: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-10112) ValueError: Can only zip with RDD which has the same number of partitions on one machine but not on another

2015-08-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703071#comment-14703071 ] Sean Owen commented on SPARK-10112: --- I don't think you've demonstrated that they have

[jira] [Resolved] (SPARK-10060) User guide for ml trees

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10060. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8244

[jira] [Created] (SPARK-10114) Add optional getters to the spark.sql.Row

2015-08-19 Thread etienne (JIRA)
etienne created SPARK-10114: --- Summary: Add optional getters to the spark.sql.Row Key: SPARK-10114 URL: https://issues.apache.org/jira/browse/SPARK-10114 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-10116) XORShiftRandom should generate uniform seeds

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10116: Assignee: Imran Rashid (was: Apache Spark) XORShiftRandom should generate uniform seeds

[jira] [Assigned] (SPARK-10116) XORShiftRandom should generate uniform seeds

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10116: Assignee: Apache Spark (was: Imran Rashid) XORShiftRandom should generate uniform seeds

[jira] [Commented] (SPARK-10116) XORShiftRandom should generate uniform seeds

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703199#comment-14703199 ] Apache Spark commented on SPARK-10116: -- User 'squito' has created a pull request for

[jira] [Commented] (SPARK-9812) Test all new Python API examples

2015-08-19 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703223#comment-14703223 ] Shixiong Zhu commented on SPARK-9812: - Tested Streaming Python examples using Python

[jira] [Resolved] (SPARK-10084) Add Python example for mllib FP-growth user guide

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10084. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8279

[jira] [Commented] (SPARK-9644) Support update DecimalType with precision 18 in UnsafeRow

2015-08-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703474#comment-14703474 ] Davies Liu commented on SPARK-9644: --- [~robbinspg] It's fixed by

[jira] [Updated] (SPARK-9665) ML 1.5 QA: API: Experimental, DeveloperApi, final, sealed audit

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9665: - Priority: Critical (was: Minor) ML 1.5 QA: API: Experimental, DeveloperApi, final, sealed audit

[jira] [Commented] (SPARK-9226) Change default log level to WARN in python REPL

2015-08-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703334#comment-14703334 ] Auberon López commented on SPARK-9226: -- Sure, I can go ahead and write one up.

[jira] [Commented] (SPARK-10022) Scala-Python method/parameter inconsistency check for ML during 1.5 QA

2015-08-19 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703349#comment-14703349 ] Feynman Liang commented on SPARK-10022: --- That would be awesome! I tried doing

[jira] [Resolved] (SPARK-5754) Spark AM not launching on Windows

2015-08-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-5754. --- Resolution: Fixed Fix Version/s: 1.6.0 Spark AM not launching on Windows

[jira] [Resolved] (SPARK-9833) Add options to explicitly disable delegation token retrieval for non-HDFS

2015-08-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9833. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 Add options

[jira] [Commented] (SPARK-4240) Refine Tree Predictions in Gradient Boosting to Improve Prediction Accuracy.

2015-08-19 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703402#comment-14703402 ] Seth Hendrickson commented on SPARK-4240: - [~pprett] MLlib's current

[jira] [Updated] (SPARK-9148) User-facing documentation for NaN handling semantics

2015-08-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9148: --- Priority: Critical (was: Blocker) User-facing documentation for NaN handling semantics

[jira] [Updated] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10118: -- Description: This includes checking if the new DataFrame functions expression

[jira] [Resolved] (SPARK-8521) Feature Transformers in 1.5

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8521. -- Resolution: Fixed Feature Transformers in 1.5 ---

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703412#comment-14703412 ] Joseph K. Bradley commented on SPARK-7780: -- Yep, 1.6 I'd say The intercept in

[jira] [Created] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-19 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-10118: - Summary: Improve SparkR API docs for 1.5 release Key: SPARK-10118 URL: https://issues.apache.org/jira/browse/SPARK-10118 Project: Spark

[jira] [Commented] (SPARK-10119) Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc is explicitly disabled

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703513#comment-14703513 ] Apache Spark commented on SPARK-10119: -- User 'vanzin' has created a pull request for

[jira] [Updated] (SPARK-9893) User guide for VectorSlicer

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9893: - Shepherd: Feynman Liang User guide for VectorSlicer ---

[jira] [Commented] (SPARK-10027) Add Python API missing methods for ml.feature

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703519#comment-14703519 ] Joseph K. Bradley commented on SPARK-10027: --- This will actually be Ok to

[jira] [Updated] (SPARK-10027) Add Python API missing methods for ml.feature

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10027: -- Target Version/s: 1.6.0 Add Python API missing methods for ml.feature

[jira] [Commented] (SPARK-4412) Parquet logger cannot be configured

2015-08-19 Thread William Dixon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703451#comment-14703451 ] William Dixon commented on SPARK-4412: -- Happening in 1.3.1 as well :( Parquet

[jira] [Created] (SPARK-10119) Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc is explicitly disabled

2015-08-19 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10119: -- Summary: Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc is explicitly disabled Key: SPARK-10119 URL: https://issues.apache.org/jira/browse/SPARK-10119

[jira] [Comment Edited] (SPARK-4240) Refine Tree Predictions in Gradient Boosting to Improve Prediction Accuracy.

2015-08-19 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703402#comment-14703402 ] Seth Hendrickson edited comment on SPARK-4240 at 8/19/15 5:26 PM:

[jira] [Updated] (SPARK-7290) Add StringVectorizer

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7290: - Parent Issue: SPARK-9930 (was: SPARK-8521) Add StringVectorizer

[jira] [Resolved] (SPARK-9208) Audit DataFrame expression API for 1.5 release

2015-08-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9208. Resolution: Fixed Fix Version/s: 1.5.0 Audit DataFrame expression API for 1.5 release

[jira] [Resolved] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9856. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9856: - Assignee: Yu Ishikawa Add expression functions into SparkR whose params are

[jira] [Commented] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703470#comment-14703470 ] Shivaram Venkataraman commented on SPARK-10118: --- [~rxin] Can you include

[jira] [Commented] (SPARK-7379) pickle.loads expects a string instead of bytes in Python 3.

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703508#comment-14703508 ] Xiangrui Meng commented on SPARK-7379: -- In Python 2: {code}

[jira] [Assigned] (SPARK-10119) Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc is explicitly disabled

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10119: Assignee: Apache Spark Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc

[jira] [Assigned] (SPARK-10119) Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc is explicitly disabled

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10119: Assignee: (was: Apache Spark) Utils.isDynamicAllocationEnabled returns wrong value

[jira] [Commented] (SPARK-10023) Unified DecisionTreeParams checkpointInterval between Scala and Python API.

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703518#comment-14703518 ] Joseph K. Bradley commented on SPARK-10023: --- Oh, I see now, thanks for

[jira] [Updated] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

2015-08-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9550: --- Priority: Major (was: Blocker) Configuration renaming, defaults changes, and deprecation for 1.5.0

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703542#comment-14703542 ] Joseph K. Bradley commented on SPARK-9963: -- Not that I know, so please go ahead.

[jira] [Updated] (SPARK-7751) Add @Since annotation to stable and experimental methods in MLlib

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7751: - Description: This is useful to check whether a feature exists in some version of Spark. This is

[jira] [Updated] (SPARK-9791) Review API for developer and experimental tags

2015-08-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9791: --- Priority: Critical (was: Blocker) Review API for developer and experimental tags

[jira] [Commented] (SPARK-9671) ML 1.5 QA: Programming guide update and migration guide

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703571#comment-14703571 ] Joseph K. Bradley commented on SPARK-9671: -- Non-breaking changes to behavior: *

[jira] [Commented] (SPARK-7379) pickle.loads expects a string instead of bytes in Python 3.

2015-08-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703583#comment-14703583 ] Davies Liu commented on SPARK-7379: --- [~mengxr] This is a known issue that how to

[jira] [Resolved] (SPARK-10120) Update MLlib website for 1.5

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10120. --- Resolution: Done Fix Version/s: 1.5.0 Update MLlib website for 1.5

[jira] [Updated] (SPARK-10106) Add `ifelse` Column function to SparkR

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10106: -- Assignee: Yu Ishikawa Add `ifelse` Column function to SparkR

  1   2   3   4   >