[jira] [Resolved] (SPARK-4393) Memory leak in connection manager timeout thread

[ https://issues.apache.org/jira/browse/SPARK-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4393. Resolution: Fixed Fix Version/s: 1.2.0 Memory leak in connection manager timeout thread

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14213942#comment-14213942 ] Jun Yang commented on SPARK-2429: - Hi Yu Ishikawa Thanks for your wonderful hierarchical

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14213945#comment-14213945 ] RJ Nowling commented on SPARK-2429: --- Hi Yu, I'm having trouble finding the function to

[jira] [Commented] (SPARK-664) Accumulator updates should get locally merged before sent to the driver

[ https://issues.apache.org/jira/browse/SPARK-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214038#comment-14214038 ] Imran Rashid commented on SPARK-664: Hi [~aash] , thanks for taking another look at

[jira] [Resolved] (SPARK-4309) Date type support missing in HiveThriftServer2

[ https://issues.apache.org/jira/browse/SPARK-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4309. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3178

[jira] [Resolved] (SPARK-4407) Thrift server for 0.13.1 doesn't deserialize complex types properly

[ https://issues.apache.org/jira/browse/SPARK-4407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4407. - Resolution: Fixed Fix Version/s: 1.2.0 Thrift server for 0.13.1 doesn't

[jira] [Created] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

Josh Rosen created SPARK-4434: - Summary: spark-submit cluster deploy mode JAR URLs are broken in 1.1.1 Key: SPARK-4434 URL: https://issues.apache.org/jira/browse/SPARK-4434 Project: Spark Issue

[jira] [Updated] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4434: -- Assignee: Andrew Or (was: Josh Rosen) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[jira] [Assigned] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-4434: - Assignee: Josh Rosen spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214123#comment-14214123 ] Josh Rosen commented on SPARK-4434: --- I think that there are only a small number of

[jira] [Commented] (SPARK-4309) Date type support missing in HiveThriftServer2

[ https://issues.apache.org/jira/browse/SPARK-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214126#comment-14214126 ] Apache Spark commented on SPARK-4309: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-4407) Thrift server for 0.13.1 doesn't deserialize complex types properly

[ https://issues.apache.org/jira/browse/SPARK-4407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214127#comment-14214127 ] Apache Spark commented on SPARK-4407: - User 'marmbrus' has created a pull request for

[jira] [Updated] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-4306: - Target Version/s: 1.2.0 LogisticRegressionWithLBFGS support for PySpark MLlib

[jira] [Commented] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214134#comment-14214134 ] Matei Zaharia commented on SPARK-4306: -- [~srinathsmn] I've assigned it to you. When

[jira] [Updated] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-4306: - Assignee: Varadharajan LogisticRegressionWithLBFGS support for PySpark MLlib

[jira] [Created] (SPARK-4435) Add setThreshold in Python LogisticRegressionModel and SVMModel

Matei Zaharia created SPARK-4435: Summary: Add setThreshold in Python LogisticRegressionModel and SVMModel Key: SPARK-4435 URL: https://issues.apache.org/jira/browse/SPARK-4435 Project: Spark

[jira] [Commented] (SPARK-603) add simple Counter API

[ https://issues.apache.org/jira/browse/SPARK-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214142#comment-14214142 ] Imran Rashid commented on SPARK-603: Hey, this was originally reported by me too

[jira] [Commented] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214146#comment-14214146 ] Apache Spark commented on SPARK-2208: - User 'XuefengWu' has created a pull request for

[jira] [Commented] (SPARK-4399) Support multiple cloud providers

[ https://issues.apache.org/jira/browse/SPARK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214153#comment-14214153 ] Patrick Wendell commented on SPARK-4399: I think this might actually be out of

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214152#comment-14214152 ] Josh Rosen commented on SPARK-4434: --- It looks like this was caused by

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214155#comment-14214155 ] Matei Zaharia commented on SPARK-4434: -- [~joshrosen] make sure to revert this on 1.2

[jira] [Created] (SPARK-4436) Debian packaging misses datanucleus jars

Mark Hamstra created SPARK-4436: --- Summary: Debian packaging misses datanucleus jars Key: SPARK-4436 URL: https://issues.apache.org/jira/browse/SPARK-4436 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214164#comment-14214164 ] Apache Spark commented on SPARK-4434: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-4437) Docs for difference between WholeTextFileRecordReader and WholeCombineFileRecordReader

Andrew Ash created SPARK-4437: - Summary: Docs for difference between WholeTextFileRecordReader and WholeCombineFileRecordReader Key: SPARK-4437 URL: https://issues.apache.org/jira/browse/SPARK-4437

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214165#comment-14214165 ] Apache Spark commented on SPARK-4434: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214166#comment-14214166 ] Aaron Davidson commented on SPARK-4434: --- Side note: the error message about file://,

[jira] [Commented] (SPARK-4399) Support multiple cloud providers

[ https://issues.apache.org/jira/browse/SPARK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214167#comment-14214167 ] Andrew Ash commented on SPARK-4399: --- Agreed that it does seem out of scope for what an

[jira] [Commented] (SPARK-3624) Failed to find Spark assembly in /usr/share/spark/lib for RELEASED debian packages

[ https://issues.apache.org/jira/browse/SPARK-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214183#comment-14214183 ] Apache Spark commented on SPARK-3624: - User 'markhamstra' has created a pull request

[jira] [Commented] (SPARK-4436) Debian packaging misses datanucleus jars

[ https://issues.apache.org/jira/browse/SPARK-4436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214182#comment-14214182 ] Apache Spark commented on SPARK-4436: - User 'markhamstra' has created a pull request

[jira] [Created] (SPARK-4438) Add HistoryServer RESTful API

Gankun Luo created SPARK-4438: - Summary: Add HistoryServer RESTful API Key: SPARK-4438 URL: https://issues.apache.org/jira/browse/SPARK-4438 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4436) Debian packaging misses datanucleus jars

[ https://issues.apache.org/jira/browse/SPARK-4436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamstra updated SPARK-4436: Description: If Spark is built with Hive support (i.e. -Phive), then the necessary datanucleus

[jira] [Updated] (SPARK-4438) Add HistoryServer RESTful API

[ https://issues.apache.org/jira/browse/SPARK-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gankun Luo updated SPARK-4438: -- Attachment: HistoryServer RESTful API Design Doc.pdf Add HistoryServer RESTful API

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214196#comment-14214196 ] Josh Rosen commented on SPARK-4434: --- Fellow Databricks folks: I've added a regression

[jira] [Comment Edited] (SPARK-4038) Outlier Detection Algorithm for MLlib

[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207925#comment-14207925 ] Ashutosh Trivedi edited comment on SPARK-4038 at 11/17/14 2:15 AM:

[jira] [Commented] (SPARK-4434) spark-submit cluster deploy mode JAR URLs are broken in 1.1.1

[ https://issues.apache.org/jira/browse/SPARK-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214199#comment-14214199 ] Josh Rosen commented on SPARK-4434: --- As a regression test, we should probably add a

[jira] [Comment Edited] (SPARK-4038) Outlier Detection Algorithm for MLlib

[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207925#comment-14207925 ] Ashutosh Trivedi edited comment on SPARK-4038 at 11/17/14 2:18 AM:

[jira] [Created] (SPARK-4439) Export RandomForest in Python

Matei Zaharia created SPARK-4439: Summary: Export RandomForest in Python Key: SPARK-4439 URL: https://issues.apache.org/jira/browse/SPARK-4439 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-4439) Expose RandomForest in Python

[ https://issues.apache.org/jira/browse/SPARK-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-4439: - Summary: Expose RandomForest in Python (was: Export RandomForest in Python) Expose RandomForest

[jira] [Commented] (SPARK-4407) Thrift server for 0.13.1 doesn't deserialize complex types properly

[ https://issues.apache.org/jira/browse/SPARK-4407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214203#comment-14214203 ] Apache Spark commented on SPARK-4407: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-4309) Date type support missing in HiveThriftServer2

[ https://issues.apache.org/jira/browse/SPARK-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214202#comment-14214202 ] Apache Spark commented on SPARK-4309: - User 'liancheng' has created a pull request for

[jira] [Created] (SPARK-4440) Enhance the job progress API to expose more information

Rui Li created SPARK-4440: - Summary: Enhance the job progress API to expose more information Key: SPARK-4440 URL: https://issues.apache.org/jira/browse/SPARK-4440 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2321) Design a proper progress reporting event listener API

[ https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214223#comment-14214223 ] Rui Li commented on SPARK-2321: --- Hey [~joshrosen], Thanks a lot for the update! I created

[jira] [Commented] (SPARK-4325) Improve spark-ec2 cluster launch times

[ https://issues.apache.org/jira/browse/SPARK-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214239#comment-14214239 ] Nicholas Chammas commented on SPARK-4325: - {quote} Replace instances of download;

[jira] [Commented] (SPARK-4147) Remove log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214261#comment-14214261 ] Nathan M commented on SPARK-4147: - This code just forces log4j on the end user which is

[jira] [Created] (SPARK-4441) Close Tachyon client when TachyonBlockManager is shut down

shimingfei created SPARK-4441: - Summary: Close Tachyon client when TachyonBlockManager is shut down Key: SPARK-4441 URL: https://issues.apache.org/jira/browse/SPARK-4441 Project: Spark Issue

[jira] [Created] (SPARK-4442) Move common unit test utilities into their own package / module

Josh Rosen created SPARK-4442: - Summary: Move common unit test utilities into their own package / module Key: SPARK-4442 URL: https://issues.apache.org/jira/browse/SPARK-4442 Project: Spark

[jira] [Commented] (SPARK-4441) Close Tachyon client when TachyonBlockManager is shut down

[ https://issues.apache.org/jira/browse/SPARK-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214274#comment-14214274 ] Apache Spark commented on SPARK-4441: - User 'shimingfei' has created a pull request

[jira] [Commented] (SPARK-4056) Upgrade snappy-java to 1.1.1.5

[ https://issues.apache.org/jira/browse/SPARK-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214278#comment-14214278 ] Josh Rosen commented on SPARK-4056: --- I've removed the Fixed Versions here, since we

[jira] [Updated] (SPARK-4056) Upgrade snappy-java to 1.1.1.5

[ https://issues.apache.org/jira/browse/SPARK-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4056: -- Fix Version/s: (was: 1.2.0) (was: 1.1.1) Upgrade snappy-java to 1.1.1.5

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Assignee: Guoqiang Li In some cases, Vectors.fromBreeze get wrong results.

[jira] [Resolved] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4422. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3281

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Priority: Minor (was: Critical) In some cases, Vectors.fromBreeze get wrong results.

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Target Version/s: 1.2.0, 1.0.3, 1.1.2 (was: 1.1.0, 1.2.0, 1.3.0) In some cases,

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Affects Version/s: (was: 1.3.0) (was: 1.2.0)

[jira] [Reopened] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-4422: -- Reopened for branch-1.0 and branch-1.1. Changed the priority to minor because `fromBreeze` is

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Affects Version/s: 1.2.0 In some cases, Vectors.fromBreeze get wrong results.

[jira] [Commented] (SPARK-4402) Output path validation of an action statement resulting in runtime exception

[ https://issues.apache.org/jira/browse/SPARK-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214320#comment-14214320 ] Vijay commented on SPARK-4402: -- Yes, output path is being validated in

[jira] [Commented] (SPARK-4437) Docs for difference between WholeTextFileRecordReader and WholeCombineFileRecordReader

[ https://issues.apache.org/jira/browse/SPARK-4437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214335#comment-14214335 ] Apache Spark commented on SPARK-4437: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-4443) Statistics bug for external table in spark sql hive

wangfei created SPARK-4443: -- Summary: Statistics bug for external table in spark sql hive Key: SPARK-4443 URL: https://issues.apache.org/jira/browse/SPARK-4443 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4443) Statistics bug for external table in spark sql hive

[ https://issues.apache.org/jira/browse/SPARK-4443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-4443: --- Description: When table is external, the `totalSize` is always zero, which will influence join

[jira] [Updated] (SPARK-4443) Statistics bug for external table in spark sql hive

[ https://issues.apache.org/jira/browse/SPARK-4443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-4443: --- Description: When table is external, `totalSize` is always zero, which will influence join

[jira] [Commented] (SPARK-4443) Statistics bug for external table in spark sql hive

[ https://issues.apache.org/jira/browse/SPARK-4443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214351#comment-14214351 ] Apache Spark commented on SPARK-4443: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-4444) Drop VD type parameter from EdgeRDD

Ankur Dave created SPARK-: - Summary: Drop VD type parameter from EdgeRDD Key: SPARK- URL: https://issues.apache.org/jira/browse/SPARK- Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4444) Drop VD type parameter from EdgeRDD

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214369#comment-14214369 ] Apache Spark commented on SPARK-: - User 'ankurdave' has created a pull request for

[jira] [Commented] (SPARK-4435) Add setThreshold in Python LogisticRegressionModel and SVMModel

[ https://issues.apache.org/jira/browse/SPARK-4435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214382#comment-14214382 ] Apache Spark commented on SPARK-4435: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-4445) Don't display storage level in toDebugString unless RDD is persisted

Patrick Wendell created SPARK-4445: -- Summary: Don't display storage level in toDebugString unless RDD is persisted Key: SPARK-4445 URL: https://issues.apache.org/jira/browse/SPARK-4445 Project:

[jira] [Updated] (SPARK-4445) Don't display storage level in toDebugString unless RDD is persisted

[ https://issues.apache.org/jira/browse/SPARK-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4445: --- Issue Type: Bug (was: Improvement) Don't display storage level in toDebugString unless RDD