[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10188: -- Shepherd: Joseph K. Bradley Target Version/s: 1.5.0 Pyspark

[jira] [Resolved] (SPARK-10260) Add @Since annotation to ml.clustering

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10260. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8455

[jira] [Resolved] (SPARK-10328) na.omit has too restrictive generic in SparkR

2015-08-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10328. --- Resolution: Fixed Assignee: Shivaram Venkataraman Fix

[jira] [Updated] (SPARK-10260) Add @Since annotation to ml.clustering

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10260: -- Assignee: Yu Ishikawa Add @Since annotation to ml.clustering

[jira] [Comment Edited] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-08-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718134#comment-14718134 ] Yanbo Liang edited comment on SPARK-9089 at 8/28/15 7:10 AM: -

[jira] [Comment Edited] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-08-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718134#comment-14718134 ] Yanbo Liang edited comment on SPARK-9089 at 8/28/15 7:09 AM: -

[jira] [Commented] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-08-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718134#comment-14718134 ] Yanbo Liang commented on SPARK-9089: CC [~joshrosen] [~pwendell] [~srowen] Failing

[jira] [Resolved] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10188. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8399

[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10188: Target Version/s: 1.5.1 (was: 1.5.0) Pyspark CrossValidator with RMSE selects incorrect model

[jira] [Commented] (SPARK-9671) ML 1.5 QA: Programming guide update and migration guide

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718150#comment-14718150 ] Apache Spark commented on SPARK-9671: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-9671) ML 1.5 QA: Programming guide update and migration guide

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9671: --- Assignee: Xiangrui Meng (was: Apache Spark) ML 1.5 QA: Programming guide update and

[jira] [Assigned] (SPARK-9671) ML 1.5 QA: Programming guide update and migration guide

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9671: --- Assignee: Apache Spark (was: Xiangrui Meng) ML 1.5 QA: Programming guide update and

[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10188: Assignee: Noel Smith Pyspark CrossValidator with RMSE selects incorrect model

[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10188: Priority: Critical (was: Major) Pyspark CrossValidator with RMSE selects incorrect model

[jira] [Updated] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-08-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9089: --- Issue Type: Bug (was: Question) Failing to run simple job on Spark Standalone Cluster

[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10188: -- Fix Version/s: (was: 1.5.0) 1.5.1 Pyspark CrossValidator with

[jira] [Commented] (SPARK-10065) Avoid triple copy of var-length objects in Array in tungsten projection

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718123#comment-14718123 ] Apache Spark commented on SPARK-10065: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-10330) Use SparkHadoopUtil TaskAttemptContext reflection methods in more places

2015-08-28 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10330: -- Summary: Use SparkHadoopUtil TaskAttemptContext reflection methods in more places Key: SPARK-10330 URL: https://issues.apache.org/jira/browse/SPARK-10330 Project: Spark

[jira] [Comment Edited] (SPARK-10149) Locality Level is ANY on Details for Stage WebUI page

2015-08-28 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718272#comment-14718272 ] Xu Chen edited comment on SPARK-10149 at 8/28/15 9:34 AM: -- I

[jira] [Commented] (SPARK-10149) Locality Level is ANY on Details for Stage WebUI page

2015-08-28 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718272#comment-14718272 ] Xu Chen commented on SPARK-10149: - I encounter this issue too at Spark 1.4.1 , so I look

[jira] [Assigned] (SPARK-10295) Dynamic allocation in Mesos does not release when RDDs are cached

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-10295: - Assignee: Sean Owen Dynamic allocation in Mesos does not release when RDDs are cached

[jira] [Resolved] (SPARK-10295) Dynamic allocation in Mesos does not release when RDDs are cached

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10295. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Issue resolved by pull

[jira] [Commented] (SPARK-9316) Add support for filtering using `[` (synonym for filter / select)

2015-08-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718267#comment-14718267 ] Felix Cheung commented on SPARK-9316: - The string form is not listed in the code

[jira] [Assigned] (SPARK-10330) Use SparkHadoopUtil TaskAttemptContext reflection methods in more places

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10330: Assignee: Apache Spark Use SparkHadoopUtil TaskAttemptContext reflection methods in more

[jira] [Assigned] (SPARK-10330) Use SparkHadoopUtil TaskAttemptContext reflection methods in more places

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10330: Assignee: (was: Apache Spark) Use SparkHadoopUtil TaskAttemptContext reflection

[jira] [Assigned] (SPARK-9803) Add transform and subset to DataFrame

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9803: --- Assignee: (was: Apache Spark) Add transform and subset to DataFrame

[jira] [Commented] (SPARK-9803) Add transform and subset to DataFrame

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718262#comment-14718262 ] Apache Spark commented on SPARK-9803: - User 'felixcheung' has created a pull request

[jira] [Commented] (SPARK-10330) Use SparkHadoopUtil TaskAttemptContext reflection methods in more places

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718171#comment-14718171 ] Apache Spark commented on SPARK-10330: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-8425) Add blacklist mechanism for task scheduling

2015-08-28 Thread Mao, Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718204#comment-14718204 ] Mao, Wei commented on SPARK-8425: - Here is the new design doc based on Saisai's previous

[jira] [Commented] (SPARK-10296) add preservesParitioning parameter to RDD.map

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718225#comment-14718225 ] Sean Owen commented on SPARK-10296: --- What do you mean that you're forced to use map? if

[jira] [Commented] (SPARK-10258) Add @Since annotation to ml.feature

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718317#comment-14718317 ] Apache Spark commented on SPARK-10258: -- User 'martinbrown' has created a pull

[jira] [Assigned] (SPARK-10258) Add @Since annotation to ml.feature

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10258: Assignee: (was: Apache Spark) Add @Since annotation to ml.feature

[jira] [Assigned] (SPARK-10258) Add @Since annotation to ml.feature

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10258: Assignee: Apache Spark Add @Since annotation to ml.feature

[jira] [Assigned] (SPARK-10288) Add a rest client for Spark on Yarn

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10288: Assignee: Apache Spark Add a rest client for Spark on Yarn

[jira] [Commented] (SPARK-10288) Add a rest client for Spark on Yarn

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718287#comment-14718287 ] Apache Spark commented on SPARK-10288: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-10288) Add a rest client for Spark on Yarn

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10288: Assignee: (was: Apache Spark) Add a rest client for Spark on Yarn

[jira] [Updated] (SPARK-10315) remove document on spark.akka.failure-detector.threshold

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10315: -- Assignee: Nan Zhu (was: Shixiong Zhu) remove document on spark.akka.failure-detector.threshold

[jira] [Commented] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718332#comment-14718332 ] Sean Owen commented on SPARK-9906: -- One tiny point of process: if a 1.5.0 RC is out, and

[jira] [Updated] (SPARK-10315) remove document on spark.akka.failure-detector.threshold

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10315: -- Assignee: Shixiong Zhu remove document on spark.akka.failure-detector.threshold

[jira] [Commented] (SPARK-7751) Add @Since annotation to stable and experimental methods in MLlib

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718179#comment-14718179 ] Xiangrui Meng commented on SPARK-7751: -- Sorry for spamming! I created one sub-task

[jira] [Commented] (SPARK-10318) Getting issue in spark connectivity with cassandra

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718233#comment-14718233 ] Sean Owen commented on SPARK-10318: --- Maybe you can clarify what works -- are you

[jira] [Comment Edited] (SPARK-10149) Locality Level is ANY on Details for Stage WebUI page

2015-08-28 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718272#comment-14718272 ] Xu Chen edited comment on SPARK-10149 at 8/28/15 9:34 AM: -- I

[jira] [Comment Edited] (SPARK-10149) Locality Level is ANY on Details for Stage WebUI page

2015-08-28 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718272#comment-14718272 ] Xu Chen edited comment on SPARK-10149 at 8/28/15 9:35 AM: -- I

[jira] [Commented] (SPARK-10325) Public Row no longer overrides hashCode / violates hashCode + equals contract

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718192#comment-14718192 ] Apache Spark commented on SPARK-10325: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-10325) Public Row no longer overrides hashCode / violates hashCode + equals contract

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10325: Assignee: Apache Spark Public Row no longer overrides hashCode / violates hashCode +

[jira] [Assigned] (SPARK-10325) Public Row no longer overrides hashCode / violates hashCode + equals contract

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10325: Assignee: (was: Apache Spark) Public Row no longer overrides hashCode / violates

[jira] [Comment Edited] (SPARK-10149) Locality Level is ANY on Details for Stage WebUI page

2015-08-28 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718272#comment-14718272 ] Xu Chen edited comment on SPARK-10149 at 8/28/15 9:37 AM: -- hi

[jira] [Updated] (SPARK-10317) start-history-server.sh CLI parsing incompatible with HistoryServer's arg parsing

2015-08-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-10317: --- Priority: Trivial (was: Major) start-history-server.sh CLI parsing incompatible with

[jira] [Comment Edited] (SPARK-10149) Locality Level is ANY on Details for Stage WebUI page

2015-08-28 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718272#comment-14718272 ] Xu Chen edited comment on SPARK-10149 at 8/28/15 9:36 AM: -- I

[jira] [Assigned] (SPARK-10172) History Server web UI gets messed up when sorting on any column

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10172: Assignee: Apache Spark History Server web UI gets messed up when sorting on any column

[jira] [Assigned] (SPARK-10172) History Server web UI gets messed up when sorting on any column

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10172: Assignee: (was: Apache Spark) History Server web UI gets messed up when sorting on

[jira] [Commented] (SPARK-10172) History Server web UI gets messed up when sorting on any column

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718376#comment-14718376 ] Apache Spark commented on SPARK-10172: -- User 'josiahsams' has created a pull request

[jira] [Commented] (SPARK-9089) Failing to run simple job on Spark Standalone Cluster

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718229#comment-14718229 ] Sean Owen commented on SPARK-9089: -- I can't reproduce this locally. You're right that it

[jira] [Assigned] (SPARK-9803) Add transform and subset to DataFrame

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9803: --- Assignee: Apache Spark Add transform and subset to DataFrame

[jira] [Commented] (SPARK-10258) Add @Since annotation to ml.feature

2015-08-28 Thread Martin Brown (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718282#comment-14718282 ] Martin Brown commented on SPARK-10258: -- [~mengxr] can you assign this to me? Add

[jira] [Commented] (SPARK-10026) Implement some common Params for regression in PySpark

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718510#comment-14718510 ] Apache Spark commented on SPARK-10026: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-6497) Class is not registered: scala.reflect.ManifestFactory$$anon$9

2015-08-28 Thread Andras Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718555#comment-14718555 ] Andras Nemeth commented on SPARK-6497: -- This is still broken in 1.4.0. I actually

[jira] [Assigned] (SPARK-10199) Avoid using reflections for parquet model save

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10199: Assignee: (was: Apache Spark) Avoid using reflections for parquet model save

[jira] [Commented] (SPARK-10199) Avoid using reflections for parquet model save

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718417#comment-14718417 ] Apache Spark commented on SPARK-10199: -- User 'vinodkc' has created a pull request

[jira] [Assigned] (SPARK-10199) Avoid using reflections for parquet model save

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10199: Assignee: Apache Spark Avoid using reflections for parquet model save

[jira] [Assigned] (SPARK-10026) Implement some common Params for regression in PySpark

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10026: Assignee: Apache Spark Implement some common Params for regression in PySpark

[jira] [Assigned] (SPARK-10026) Implement some common Params for regression in PySpark

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10026: Assignee: (was: Apache Spark) Implement some common Params for regression in PySpark

[jira] [Commented] (SPARK-6497) Class is not registered: scala.reflect.ManifestFactory$$anon$9

2015-08-28 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718559#comment-14718559 ] Daniel Darabos commented on SPARK-6497: --- I've checked 1.5.0-RC2 and the repro still

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility with Apache Sentry

2015-08-28 Thread Giovanni Lanzani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718567#comment-14718567 ] Giovanni Lanzani commented on SPARK-9042: - If this is ironic, no I don't have an

[jira] [Updated] (SPARK-6497) Class is not registered: scala.reflect.ManifestFactory$$anon$9

2015-08-28 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos updated SPARK-6497: -- Priority: Major (was: Minor) Class is not registered: scala.reflect.ManifestFactory$$anon$9

[jira] [Updated] (SPARK-6497) Class is not registered: scala.reflect.ManifestFactory$$anon$9

2015-08-28 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos updated SPARK-6497: -- Affects Version/s: 1.5.0 1.4.0 Class is not registered:

[jira] [Updated] (SPARK-10026) Implement some common Params for regression in PySpark

2015-08-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10026: Description: Currently some Params are not common classes in Python API which lead we need to

[jira] [Commented] (SPARK-10199) Avoid using reflections for parquet model save

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718609#comment-14718609 ] Xiangrui Meng commented on SPARK-10199: --- What is the overhead? Do we have

[jira] [Updated] (SPARK-9890) User guide for CountVectorizer

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9890: - Assignee: yuhao yang User guide for CountVectorizer --

[jira] [Created] (SPARK-10331) Update user guide to address minor comments during code review

2015-08-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10331: - Summary: Update user guide to address minor comments during code review Key: SPARK-10331 URL: https://issues.apache.org/jira/browse/SPARK-10331 Project: Spark

[jira] [Resolved] (SPARK-9890) User guide for CountVectorizer

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9890. -- Resolution: Fixed Fix Version/s: 1.5.1 Issue resolved by pull request 8487

[jira] [Commented] (SPARK-8514) LU factorization on BlockMatrix

2015-08-28 Thread Jerome (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14719986#comment-14719986 ] Jerome commented on SPARK-8514: --- I am currently working through an issue with the

[jira] [Comment Edited] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-28 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720966#comment-14720966 ] Luvsandondov Lkhamsuren edited comment on SPARK-9963 at 8/29/15 4:31 AM:

[jira] [Comment Edited] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-28 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720966#comment-14720966 ] Luvsandondov Lkhamsuren edited comment on SPARK-9963 at 8/29/15 4:31 AM:

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-28 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720966#comment-14720966 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Thanks Trevor Cai! I was

[jira] [Resolved] (SPARK-9803) Add transform and subset to DataFrame

2015-08-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9803. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s:

[jira] [Updated] (SPARK-8517) Improve the organization and style of MLlib's user guide

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8517: - Target Version/s: 1.6.0 (was: 1.5.0) Improve the organization and style of MLlib's user guide

[jira] [Updated] (SPARK-7457) Perf test for ALS.recommendAll

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7457: - Target Version/s: 1.6.0 (was: 1.5.0) Perf test for ALS.recommendAll

[jira] [Resolved] (SPARK-9910) User guide for train validation split

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9910. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8377

[jira] [Updated] (SPARK-10346) SparkR mutate and transform should replace column with same name to match R data.frame behavior

2015-08-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-10346: - Description: Spark doesn't seem to replace existing column with the name in mutate (ie.

[jira] [Updated] (SPARK-10340) Use S3 bulk listing for S3-backed Hive tables

2015-08-28 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10340: Assignee: Cheolsoo Park Use S3 bulk listing for S3-backed Hive tables

[jira] [Commented] (SPARK-8952) JsonFile() of SQLContext display improper warning message for a S3 path

2015-08-28 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720889#comment-14720889 ] Sun Rui commented on SPARK-8952: I submitted

[jira] [Created] (SPARK-10347) Investigate the usage of normalizePath()

2015-08-28 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10347: --- Summary: Investigate the usage of normalizePath() Key: SPARK-10347 URL: https://issues.apache.org/jira/browse/SPARK-10347 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10337) Views are broken

2015-08-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720922#comment-14720922 ] Yin Huai commented on SPARK-10337: -- I think this will break if the view is created from

[jira] [Commented] (SPARK-9042) Spark SQL incompatibility with Apache Sentry

2015-08-28 Thread Nitin Kak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720977#comment-14720977 ] Nitin Kak commented on SPARK-9042: -- I agree. This is a broader issue, it only does not

[jira] [Updated] (SPARK-10117) Implement SQL data source API for reading LIBSVM data

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10117: -- Assignee: Kai Sasaki Implement SQL data source API for reading LIBSVM data

[jira] [Created] (SPARK-10333) Add user guide for linear-methods.md columns

2015-08-28 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10333: - Summary: Add user guide for linear-methods.md columns Key: SPARK-10333 URL: https://issues.apache.org/jira/browse/SPARK-10333 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8952) JsonFile() of SQLContext display improper warning message for a S3 path

2015-08-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8952: - Assignee: Luciano Resende JsonFile() of SQLContext display improper warning

[jira] [Comment Edited] (SPARK-10055) San Francisco Crime Classification

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720245#comment-14720245 ] Xiangrui Meng edited comment on SPARK-10055 at 8/28/15 5:05 PM:

[jira] [Commented] (SPARK-10199) Avoid using reflections for parquet model save

2015-08-28 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720277#comment-14720277 ] Feynman Liang commented on SPARK-10199: --- [~vinodkc] would it be possible to get

[jira] [Updated] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-08-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8057: -- Fix Version/s: 1.4.2 Call TaskAttemptContext.getTaskAttemptID using Reflection

[jira] [Commented] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720201#comment-14720201 ] Sean Owen commented on SPARK-10332: --- I think this was changed to allow 0 (could be

[jira] [Comment Edited] (SPARK-10055) San Francisco Crime Classification

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720245#comment-14720245 ] Xiangrui Meng edited comment on SPARK-10055 at 8/28/15 5:05 PM:

[jira] [Created] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-08-28 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10332: - Summary: spark-submit to yarn doesn't fail if executors is 0 Key: SPARK-10332 URL: https://issues.apache.org/jira/browse/SPARK-10332 Project: Spark Issue

[jira] [Resolved] (SPARK-8952) JsonFile() of SQLContext display improper warning message for a S3 path

2015-08-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8952. -- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Issue

[jira] [Assigned] (SPARK-10301) For struct type, if parquet's global schema has less fields than a file's schema, data reading will fail

2015-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10301: Assignee: Apache Spark (was: Yin Huai) For struct type, if parquet's global schema has

[jira] [Commented] (SPARK-10117) Implement SQL data source API for reading LIBSVM data

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720208#comment-14720208 ] Xiangrui Meng commented on SPARK-10117: --- Assigned:) Implement SQL data source API

[jira] [Commented] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-08-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720222#comment-14720222 ] Thomas Graves commented on SPARK-10332: --- Unless something else has changed that was

[jira] [Comment Edited] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-08-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720222#comment-14720222 ] Thomas Graves edited comment on SPARK-10332 at 8/28/15 4:52 PM:

[jira] [Commented] (SPARK-10055) San Francisco Crime Classification

2015-08-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720232#comment-14720232 ] Xiangrui Meng commented on SPARK-10055: --- [~yinxusen] Since [~kaisasak] already

  1   2   >