[jira] [Commented] (SPARK-1934) "this" reference escape to "selectorThread" during construction in ConnectionManager

2015-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293839#comment-14293839 ] Apache Spark commented on SPARK-1934: - User 'srowen' has created a pull request for th

[jira] [Comment Edited] (SPARK-5428) Declare the 'assembly' module at the bottom of the element in the parent POM

2015-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293834#comment-14293834 ] Sean Owen edited comment on SPARK-5428 at 1/27/15 5:21 PM: --- I th

[jira] [Commented] (SPARK-5428) Declare the 'assembly' module at the bottom of the element in the parent POM

2015-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293834#comment-14293834 ] Sean Owen commented on SPARK-5428: -- I think you have a point there. At least, I don't thi

[jira] [Commented] (SPARK-5429) Can't generate Hive golden answer on Hive 0.13.1

2015-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293828#comment-14293828 ] Apache Spark commented on SPARK-5429: - User 'viirya' has created a pull request for th

[jira] [Created] (SPARK-5429) Can't generate Hive golden answer on Hive 0.13.1

2015-01-27 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-5429: -- Summary: Can't generate Hive golden answer on Hive 0.13.1 Key: SPARK-5429 URL: https://issues.apache.org/jira/browse/SPARK-5429 Project: Spark Issue Type

[jira] [Commented] (SPARK-2008) Enhance spark-ec2 to be able to add and remove slaves to an existing cluster

2015-01-27 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293805#comment-14293805 ] Nicholas Chammas commented on SPARK-2008: - This isn't implemented. {{--use-existin

[jira] [Comment Edited] (SPARK-5395) Large number of Python workers causing resource depletion

2015-01-27 Thread Mark Khaitman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293653#comment-14293653 ] Mark Khaitman edited comment on SPARK-5395 at 1/27/15 4:26 PM: -

[jira] [Created] (SPARK-5428) Declare the 'assembly' module at the bottom of the element in the parent POM

2015-01-27 Thread Christian Tzolov (JIRA)
Christian Tzolov created SPARK-5428: --- Summary: Declare the 'assembly' module at the bottom of the element in the parent POM Key: SPARK-5428 URL: https://issues.apache.org/jira/browse/SPARK-5428 Pro

[jira] [Commented] (SPARK-2008) Enhance spark-ec2 to be able to add and remove slaves to an existing cluster

2015-01-27 Thread Grzegorz Dubicki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293708#comment-14293708 ] Grzegorz Dubicki commented on SPARK-2008: - Isn't this implemented already? If not

[jira] [Commented] (SPARK-5395) Large number of Python workers causing resource depletion

2015-01-27 Thread Mark Khaitman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293653#comment-14293653 ] Mark Khaitman commented on SPARK-5395: -- Actually I think I know why this happens... I

[jira] [Commented] (SPARK-1742) Profiler for Spark

2015-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293617#comment-14293617 ] Sean Owen commented on SPARK-1742: -- Is it realistic to expect that this would be part of

[jira] [Created] (SPARK-5427) Add support for floor function in Spark SQL

2015-01-27 Thread Ted Yu (JIRA)
Ted Yu created SPARK-5427: - Summary: Add support for floor function in Spark SQL Key: SPARK-5427 URL: https://issues.apache.org/jira/browse/SPARK-5427 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-3439) Add Canopy Clustering Algorithm

2015-01-27 Thread Muhammad-Ali A'rabi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293526#comment-14293526 ] Muhammad-Ali A'rabi commented on SPARK-3439: Input is a collection of vectors

[jira] [Commented] (SPARK-5426) SchemaRDD is java incompatible

2015-01-27 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293436#comment-14293436 ] Kuldeep commented on SPARK-5426: This looks related to https://issues.apache.org/jira/brow

[jira] [Created] (SPARK-5426) SchemaRDD is java incompatible

2015-01-27 Thread Kuldeep (JIRA)
Kuldeep created SPARK-5426: -- Summary: SchemaRDD is java incompatible Key: SPARK-5426 URL: https://issues.apache.org/jira/browse/SPARK-5426 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293424#comment-14293424 ] Jacek Lewandowski commented on SPARK-5425: -- [~joshrosen] can you take a look? >

[jira] [Commented] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293423#comment-14293423 ] Apache Spark commented on SPARK-5425: - User 'jacek-lewandowski' has created a pull req

[jira] [Commented] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293421#comment-14293421 ] Apache Spark commented on SPARK-5425: - User 'jacek-lewandowski' has created a pull req

[jira] [Commented] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293417#comment-14293417 ] Apache Spark commented on SPARK-5425: - User 'jacek-lewandowski' has created a pull req

[jira] [Commented] (SPARK-5162) Python yarn-cluster mode

2015-01-27 Thread Vladimir Grigor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293397#comment-14293397 ] Vladimir Grigor commented on SPARK-5162: [~lianhuiwang] Thank you for reply :) yar

[jira] [Updated] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5425: - Description: This fragment of code: {code} if (loadDefaults) { // Load any spark.*

[jira] [Resolved] (SPARK-2812) convert maven to archetype based build

2015-01-27 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-2812. Resolution: Invalid > convert maven to archetype based build > -

[jira] [Commented] (SPARK-2812) convert maven to archetype based build

2015-01-27 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293300#comment-14293300 ] Prashant Sharma commented on SPARK-2812: This can be closed since we chose a rathe

[jira] [Commented] (SPARK-5162) Python yarn-cluster mode

2015-01-27 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293271#comment-14293271 ] Lianhui Wang commented on SPARK-5162: - [~vgrigor] thank you for asking some questions.

[jira] [Created] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5425: Summary: ConcurrentModificationException during SparkConf creation Key: SPARK-5425 URL: https://issues.apache.org/jira/browse/SPARK-5425 Project: Spark

[jira] [Created] (SPARK-5424) Make the new ALS implementation take generic ID types

2015-01-27 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5424: Summary: Make the new ALS implementation take generic ID types Key: SPARK-5424 URL: https://issues.apache.org/jira/browse/SPARK-5424 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-5321) Add transpose() method to Matrix

2015-01-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5321. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4109 [https://githu

[jira] [Resolved] (SPARK-5419) Fix the logic in Vectors.sqdist

2015-01-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5419. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4217 [https://githu

[jira] [Commented] (SPARK-3298) [SQL] registerAsTable / registerTempTable overwrites old tables

2015-01-27 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293205#comment-14293205 ] shengli commented on SPARK-3298: @Michael Armbrust Would you please give some comments f

[jira] [Commented] (SPARK-5300) Spark loads file partitions in inconsistent order on native filesystems

2015-01-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293201#comment-14293201 ] Ewan Higgs commented on SPARK-5300: --- The PR appears to have been rejected on the grounds

[jira] [Comment Edited] (SPARK-5377) Dynamically add jar into Spark Driver's classpath.

2015-01-27 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293186#comment-14293186 ] Jongyoul Lee edited comment on SPARK-5377 at 1/27/15 8:44 AM: --

[jira] [Commented] (SPARK-5051) python: module pyspark.daemon not found

2015-01-27 Thread naveen kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293190#comment-14293190 ] naveen kumar commented on SPARK-5051: - Yes i have installed python on that location an

[jira] [Commented] (SPARK-5377) Dynamically add jar into Spark Driver's classpath.

2015-01-27 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293186#comment-14293186 ] Jongyoul Lee commented on SPARK-5377: - It's really needed. When we use HiveContext and

[jira] [Commented] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

2015-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293173#comment-14293173 ] Apache Spark commented on SPARK-5423: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

2015-01-27 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5423: --- Summary: ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it Key: SPARK-5423 URL: https://issues.apache.org/jira/browse/SPARK-5423

<    1   2