[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060650#comment-15060650 ] Jakob Odersky commented on SPARK-12350: --- A git-bisect showed that the issue was introduced in

[jira] [Created] (SPARK-12374) Improve performance of range API via adding logical/physical operators

2015-12-16 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12374: --- Summary: Improve performance of range API via adding logical/physical operators Key: SPARK-12374 URL: https://issues.apache.org/jira/browse/SPARK-12374 Project: Spark

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: Apache Spark > Improve performance of Range APIs via adding logical/physical

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: (was: Apache Spark) > Improve performance of Range APIs via adding

[jira] [Assigned] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12350: Assignee: Apache Spark > VectorAssembler#transform() initially throws an exception >

[jira] [Commented] (SPARK-12372) Unary operator "-" fails for MLlib vectors

2015-12-16 Thread Christos Iraklis Tsatsoulis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060858#comment-15060858 ] Christos Iraklis Tsatsoulis commented on SPARK-12372: - If this is the case, then a

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060873#comment-15060873 ] Apache Spark commented on SPARK-12350: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060732#comment-15060732 ] Jakob Odersky commented on SPARK-12350: --- No functionality is broken, so if the exception can be

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060819#comment-15060819 ] Jakob Odersky commented on SPARK-12350: --- Ok, thanks! > VectorAssembler#transform() initially

[jira] [Commented] (SPARK-12331) R^2 for regression through the origin

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060875#comment-15060875 ] Joseph K. Bradley commented on SPARK-12331: --- +1 for this change based on the description

[jira] [Created] (SPARK-12371) Make sure Dataset nullability conforms to its underlying logical plan

2015-12-16 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12371: -- Summary: Make sure Dataset nullability conforms to its underlying logical plan Key: SPARK-12371 URL: https://issues.apache.org/jira/browse/SPARK-12371 Project: Spark

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060475#comment-15060475 ] Apache Spark commented on SPARK-12345: -- User 'tnachen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12054) Consider nullable in codegen

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060489#comment-15060489 ] Apache Spark commented on SPARK-12054: -- User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12361: --- Assignee: Jeff Zhang > Should set PYSPARK_DRIVER_PYTHON before python test >

[jira] [Updated] (SPARK-12057) Prevent failure on corrupt JSON records

2015-12-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12057: - Target Version/s: 1.6.1, 2.0.0 (was: 1.6.0) > Prevent failure on corrupt JSON records >

[jira] [Updated] (SPARK-12273) Spark Streaming Web UI does not list Receivers in order

2015-12-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12273: - Assignee: Liwei Lin > Spark Streaming Web UI does not list Receivers in order >

[jira] [Updated] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12361: --- Target Version/s: (was: 1.6.1) > Should set PYSPARK_DRIVER_PYTHON before python test >

[jira] [Updated] (SPARK-12373) Type coercion rule of dividing two decimal values may choose an intermediate precision that does not have enough number of digits at the left of decimal point

2015-12-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12373: - Summary: Type coercion rule of dividing two decimal values may choose an intermediate precision that

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060740#comment-15060740 ] Marcelo Vanzin commented on SPARK-12350: bq. should the exception not be treated as an error? No

[jira] [Updated] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12364: -- Assignee: Yanbo Liang (was: Apache Spark) > Add ML example for SparkR >

[jira] [Resolved] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12364. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12363: -- Priority: Minor (was: Major) > PowerIterationClustering test case failed if we

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060862#comment-15060862 ] Joseph K. Bradley commented on SPARK-12363: --- Thanks for identifying this. What do the

[jira] [Updated] (SPARK-12304) Make Spark Streaming web UI display more friendly Receiver graphs

2015-12-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12304: - Assignee: Liwei Lin > Make Spark Streaming web UI display more friendly Receiver graphs >

[jira] [Commented] (SPARK-12372) Unary operator "-" fails for MLlib vectors

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060699#comment-15060699 ] Joseph K. Bradley commented on SPARK-12372: --- There simply isn't a unary operation. There are

[jira] [Closed] (SPARK-12372) Unary operator "-" fails for MLlib vectors

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12372. - Resolution: Not A Problem > Unary operator "-" fails for MLlib vectors >

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: Apache Spark > Improve performance of Range APIs via adding logical/physical

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: (was: Apache Spark) > Improve performance of Range APIs via adding

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060773#comment-15060773 ] Jakob Odersky commented on SPARK-12350: --- Ok, but then why throw an exception in the first place? >

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: Apache Spark > Improve performance of Range APIs via adding logical/physical

[jira] [Updated] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12364: -- Assignee: Yanbo Liang > Add ML example for SparkR > - > >

[jira] [Resolved] (SPARK-12361) Should set PYSPARK_DRIVER_PYTHON before python test

2015-12-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12361. Resolution: Fixed Fix Version/s: 2.0.0 Fixed by https://github.com/apache/spark/pull/10322

[jira] [Updated] (SPARK-12373) Type coercion rule of dividing two decimal values may choose an intermediate precision that does not enough number of digits at the left of decimal point

2015-12-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12373: - Summary: Type coercion rule of dividing two decimal values may choose an intermediate precision that

[jira] [Assigned] (SPARK-12364) Add ML example for SparkR

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12364: Assignee: Apache Spark (was: Yanbo Liang) > Add ML example for SparkR >

[jira] [Commented] (SPARK-12326) Move GBT implementation from spark.mllib to spark.ml

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060887#comment-15060887 ] Joseph K. Bradley commented on SPARK-12326: --- The plan sounds good. The critical item is #1 of

[jira] [Created] (SPARK-12373) Type coercion rule for dividing two decimal values may choose an intermediate precision that does not enough number of digits at the left of decimal point

2015-12-16 Thread Yin Huai (JIRA)
Yin Huai created SPARK-12373: Summary: Type coercion rule for dividing two decimal values may choose an intermediate precision that does not enough number of digits at the left of decimal point Key: SPARK-12373

[jira] [Resolved] (SPARK-11608) ML 1.6 QA: Programming guide update and migration guide

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11608. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12374: Summary: Improve performance of Range APIs via adding logical/physical operators (was: Improve

[jira] [Commented] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060720#comment-15060720 ] Joseph K. Bradley commented on SPARK-12367: --- This is likely caused by a feature value 1.0 which

[jira] [Closed] (SPARK-12367) NoSuchElementException during prediction with Random Forest Regressor

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12367. - Resolution: Duplicate > NoSuchElementException during prediction with Random Forest

[jira] [Created] (SPARK-12375) VectorIndexer: allow unknown categories

2015-12-16 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-12375: - Summary: VectorIndexer: allow unknown categories Key: SPARK-12375 URL: https://issues.apache.org/jira/browse/SPARK-12375 Project: Spark Issue

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060721#comment-15060721 ] Marcelo Vanzin commented on SPARK-12350: I understand where the exception is coming from, I'm

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060865#comment-15060865 ] Joseph K. Bradley commented on SPARK-12363: --- Setting priority to Minor since we'll notice this

[jira] [Updated] (SPARK-12273) Spark Streaming Web UI does not list Receivers in order

2015-12-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12273: - Affects Version/s: 1.6.0 > Spark Streaming Web UI does not list Receivers in order >

[jira] [Assigned] (SPARK-12057) Prevent failure on corrupt JSON records

2015-12-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-12057: Assignee: Yin Huai > Prevent failure on corrupt JSON records >

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060668#comment-15060668 ] Marcelo Vanzin commented on SPARK-12350: So, if I understand correctly, the issue is just the

[jira] [Updated] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12374: Issue Type: Improvement (was: Bug) > Improve performance of Range APIs via adding logical/physical

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060705#comment-15060705 ] Jakob Odersky commented on SPARK-12350: --- The end result seems to work, the console is however

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: Apache Spark > Improve performance of Range APIs via adding logical/physical

[jira] [Assigned] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12374: Assignee: (was: Apache Spark) > Improve performance of Range APIs via adding

[jira] [Created] (SPARK-12376) Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

2015-12-16 Thread Evan Chen (JIRA)
Evan Chen created SPARK-12376: - Summary: Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method Key: SPARK-12376 URL: https://issues.apache.org/jira/browse/SPARK-12376 Project: Spark

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060788#comment-15060788 ] Marcelo Vanzin commented on SPARK-12350: Well, that's what the fix will be. >

[jira] [Created] (SPARK-12377) Wrong implementation for Row.__call__ in pyspark

2015-12-16 Thread Irakli Machabeli (JIRA)
Irakli Machabeli created SPARK-12377: Summary: Wrong implementation for Row.__call__ in pyspark Key: SPARK-12377 URL: https://issues.apache.org/jira/browse/SPARK-12377 Project: Spark

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken when SPARK_HOME is set

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Summary: Mesos cluster mode is broken when SPARK_HOME is set (was: Mesos cluster mode is broken) >

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Summary: Mesos cluster mode is broken (was: Mesos cluster mode is broken when SPARK_HOME is set) >

[jira] [Assigned] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12289: Assignee: Apache Spark > Support UnsafeRow in TakeOrderedAndProject/Limit >

[jira] [Commented] (SPARK-12289) Support UnsafeRow in TakeOrderedAndProject/Limit

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060287#comment-15060287 ] Apache Spark commented on SPARK-12289: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-12318) Save mode in SparkR should be error by default

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12318: -- Assignee: Jeff Zhang > Save mode in SparkR should be error by default >

[jira] [Resolved] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12345. --- Resolution: Fixed Assignee: Luc Bourlier (was: Apache Spark) > Mesos cluster mode is broken >

[jira] [Assigned] (SPARK-12371) Make sure Dataset nullability conforms to its underlying logical plan

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12371: Assignee: Apache Spark (was: Cheng Lian) > Make sure Dataset nullability conforms to its

[jira] [Resolved] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12324. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Fix Version/s: 1.6.0 > Mesos cluster mode is broken > > >

[jira] [Resolved] (SPARK-6518) Add example code and user guide for bisecting k-means

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6518. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-12309) Use sqlContext from MLlibTestSparkContext for spark.ml test suites

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12309. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10279

[jira] [Commented] (SPARK-10951) Support private S3 repositories using spark-submit via --repositories flag

2015-12-16 Thread Jerry Lam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060451#comment-15060451 ] Jerry Lam commented on SPARK-10951: --- Any change to have this feature in 1.6? :) > Support private S3

[jira] [Resolved] (SPARK-12215) User guide section for KMeans in spark.ml

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12215. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060381#comment-15060381 ] Shivaram Venkataraman commented on SPARK-12360: --- The lack of 64 bit numbers is a limitation

[jira] [Resolved] (SPARK-12318) Save mode in SparkR should be error by default

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12318. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-8745) Remove GenerateProjection

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8745. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10316

[jira] [Resolved] (SPARK-12310) Add write.json and write.parquet for SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12310. --- Resolution: Fixed Assignee: Yanbo Liang (was: Apache Spark)

[jira] [Comment Edited] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060500#comment-15060500 ] Jakob Odersky edited comment on SPARK-12350 at 12/16/15 6:55 PM: - You're

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Target Version/s: 1.6.0 (was: 1.6.1) > Mesos cluster mode is broken > >

[jira] [Commented] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060500#comment-15060500 ] Jakob Odersky commented on SPARK-12350: --- You're right, somewhere in the huge stack trace output I

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12324: -- Target Version/s: 1.6.1, 2.0.0 > The documentation sidebar does not collapse properly

[jira] [Created] (SPARK-12372) Unary operator "-" fails for MLlib vectors

2015-12-16 Thread Christos Iraklis Tsatsoulis (JIRA)
Christos Iraklis Tsatsoulis created SPARK-12372: --- Summary: Unary operator "-" fails for MLlib vectors Key: SPARK-12372 URL: https://issues.apache.org/jira/browse/SPARK-12372 Project:

[jira] [Resolved] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9694. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9108

[jira] [Assigned] (SPARK-12376) Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12376: Assignee: (was: Apache Spark) > Spark Streaming Java8APISuite fails in

[jira] [Assigned] (SPARK-12376) Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12376: Assignee: Apache Spark > Spark Streaming Java8APISuite fails in

[jira] [Updated] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11834: -- Target Version/s: 1.6.1, 2.0.0 (was: 1.6.0) > Ignore thresholds in LogisticRegression

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061051#comment-15061051 ] Joseph K. Bradley commented on SPARK-10931: --- I'd very strongly prefer not to modify every

[jira] [Commented] (SPARK-12272) Gradient boosted trees: too slow at the first finding best siplts

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061064#comment-15061064 ] Joseph K. Bradley commented on SPARK-12272: --- First comment: I'd check the number of partitions

[jira] [Closed] (SPARK-12272) Gradient boosted trees: too slow at the first finding best siplts

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12272. - Resolution: Duplicate > Gradient boosted trees: too slow at the first finding best

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

2015-12-16 Thread Evan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061090#comment-15061090 ] Evan Chen commented on SPARK-10931: --- Hey Joseph, If using the getattr method, are you suggesting

[jira] [Commented] (SPARK-12386) Setting "spark.executor.port" leads to NPE in SparkEnv

2015-12-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1506#comment-1506 ] Shixiong Zhu commented on SPARK-12386: -- If the user doesn't depend on the assumption that

[jira] [Resolved] (SPARK-12380) MLLib should use existing SQLContext instead create new one

2015-12-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12380. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Resolved] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12164. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10215

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12164: - Assignee: Xiao Li > [SQL] Display the binary/encoded values >

[jira] [Updated] (SPARK-12350) VectorAssembler#transform() initially throws an exception

2015-12-16 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-12350: -- Component/s: (was: ML) Spark Shell Spark Core >

[jira] [Created] (SPARK-12381) Move decision tree helper classes from spark.mllib to spark.ml

2015-12-16 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-12381: Summary: Move decision tree helper classes from spark.mllib to spark.ml Key: SPARK-12381 URL: https://issues.apache.org/jira/browse/SPARK-12381 Project:

[jira] [Created] (SPARK-12382) Remove spark.mllib GBT implementation and wrap spark.ml

2015-12-16 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-12382: Summary: Remove spark.mllib GBT implementation and wrap spark.ml Key: SPARK-12382 URL: https://issues.apache.org/jira/browse/SPARK-12382 Project: Spark

[jira] [Updated] (SPARK-9690) Add random seed Param to PySpark CrossValidator

2015-12-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9690: - Assignee: Martin Menestret > Add random seed Param to PySpark CrossValidator >

[jira] [Commented] (SPARK-12380) MLLib should use existing SQLContext instead create new one

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060990#comment-15060990 ] Apache Spark commented on SPARK-12380: -- User 'davies' has created a pull request for this issue:

[jira] [Commented] (SPARK-12331) R^2 for regression through the origin

2015-12-16 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061039#comment-15061039 ] DB Tsai commented on SPARK-12331: - +1 PR is welcome. Thanks. > R^2 for regression through the origin >

[jira] [Resolved] (SPARK-12320) throw exception if the number of fields does not line up for Tuple encoder

2015-12-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12320. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10293

[jira] [Updated] (SPARK-12320) throw exception if the number of fields does not line up for Tuple encoder

2015-12-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12320: - Assignee: Wenchen Fan > throw exception if the number of fields does not line up for

[jira] [Created] (SPARK-12380) MLLib should use existing SQLContext instead create new one

2015-12-16 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12380: -- Summary: MLLib should use existing SQLContext instead create new one Key: SPARK-12380 URL: https://issues.apache.org/jira/browse/SPARK-12380 Project: Spark

[jira] [Updated] (SPARK-12326) Move GBT implementation from spark.mllib to spark.ml

2015-12-16 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Hendrickson updated SPARK-12326: - Description: Several improvements can be made to gradient boosted trees, but are not

[jira] [Created] (SPARK-12383) Move unit tests for GBT from spark.mllib to spark.ml

2015-12-16 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-12383: Summary: Move unit tests for GBT from spark.mllib to spark.ml Key: SPARK-12383 URL: https://issues.apache.org/jira/browse/SPARK-12383 Project: Spark

[jira] [Assigned] (SPARK-12380) MLLib should use existing SQLContext instead create new one

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12380: Assignee: Apache Spark (was: Davies Liu) > MLLib should use existing SQLContext instead

[jira] [Assigned] (SPARK-12380) MLLib should use existing SQLContext instead create new one

2015-12-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12380: Assignee: Davies Liu (was: Apache Spark) > MLLib should use existing SQLContext instead

  1   2   3   4   >