[jira] [Created] (SPARK-2151) spark-submit issue (int format expected for memory parameter)

2014-06-16 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-2151: --- Summary: spark-submit issue (int format expected for memory parameter) Key: SPARK-2151 URL: https://issues.apache.org/jira/browse/SPARK-2151 Project: Spark

[jira] [Commented] (SPARK-2151) spark-submit issue (int format expected for memory parameter)

2014-06-16 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032133#comment-14032133 ] Nishkam Ravi commented on SPARK-2151: - PR: https://github.com/apache/spark/pull/1095/

[jira] [Resolved] (SPARK-1999) UI : StorageLevel in storage tab and RDD Storage Info never changes

2014-06-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1999. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Target

[jira] [Updated] (SPARK-1999) UI : StorageLevel in storage tab and RDD Storage Info never changes

2014-06-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1999: --- Assignee: Chen Chao UI : StorageLevel in storage tab and RDD Storage Info never changes

[jira] [Updated] (SPARK-2148) Document custom class as key needing equals() AND hashcode()

2014-06-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2148: --- Issue Type: Improvement (was: Bug) Document custom class as key needing equals() AND

[jira] [Resolved] (SPARK-2148) Document custom class as key needing equals() AND hashcode()

2014-06-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2148. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Updated] (SPARK-2148) Document custom class as key needing equals() AND hashcode()

2014-06-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2148: --- Assignee: Andrew Ash Document custom class as key needing equals() AND hashcode()

[jira] [Resolved] (SPARK-2039) Run hadoop output checks for all formats

2014-06-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2039. Resolution: Fixed Fix Version/s: 1.1.0 Fixed by:

[jira] [Updated] (SPARK-1946) Submit stage after executors have been registered

2014-06-16 Thread Zhihui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihui updated SPARK-1946: -- Description: Because creating TaskSetManager and registering executors are asynchronous, if running job

[jira] [Created] (SPARK-2152) the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib

2014-06-16 Thread caoli (JIRA)
caoli created SPARK-2152: Summary: the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib Key: SPARK-2152 URL: https://issues.apache.org/jira/browse/SPARK-2152 Project: Spark

[jira] [Commented] (SPARK-2018) Big-Endian (IBM Power7) Spark Serialization issue

2014-06-16 Thread Gireesh Punathil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032255#comment-14032255 ] Gireesh Punathil commented on SPARK-2018: - I was able to identify the root cause.

[jira] [Commented] (SPARK-2126) Move MapOutputTracker behind ShuffleManager interface

2014-06-16 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032319#comment-14032319 ] Nan Zhu commented on SPARK-2126: [~matei], how about assigning it to me? I'm interested in

[jira] [Commented] (SPARK-1291) Link the spark UI to RM ui in yarn-client mode

2014-06-16 Thread Rahul Singhal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032343#comment-14032343 ] Rahul Singhal commented on SPARK-1291: -- I was trying my hand at providing UI while

[jira] [Created] (SPARK-2153) Spark Examples

2014-06-16 Thread vishnu (JIRA)
vishnu created SPARK-2153: - Summary: Spark Examples Key: SPARK-2153 URL: https://issues.apache.org/jira/browse/SPARK-2153 Project: Spark Issue Type: Bug Components: Examples Affects

[jira] [Created] (SPARK-2154) Worker goes down.

2014-06-16 Thread siva venkat gogineni (JIRA)
siva venkat gogineni created SPARK-2154: --- Summary: Worker goes down. Key: SPARK-2154 URL: https://issues.apache.org/jira/browse/SPARK-2154 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

2014-06-16 Thread Zongheng Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2155: - Description: Currently we translate CASE KEY WHEN to CASE WHEN, hence incurring redundant

[jira] [Updated] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

2014-06-16 Thread Zongheng Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2155: - Description: Currently we translate CASE KEY WHEN to CASE WHEN, hence incurring redundant

[jira] [Resolved] (SPARK-1903) Document Spark's network connections

2014-06-16 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash resolved SPARK-1903. --- Resolution: Fixed Fix Version/s: 1.0.0 Merged into master and branch-1.0 in time for the

[jira] [Commented] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

2014-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032803#comment-14032803 ] Sean Owen commented on SPARK-2100: -- Tomcat and Jetty classes don't overlap -- do you mean

[jira] [Resolved] (SPARK-1930) The Container is running beyond physical memory limits, so as to be killed.

2014-06-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1930. -- Resolution: Fixed Fix Version/s: 1.1.0 The Container is running beyond physical memory

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

2014-06-16 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032867#comment-14032867 ] Chen Jin commented on SPARK-1112: - To follow up this thread, I have done some experiments

[jira] [Commented] (SPARK-2010) Support for nested data in PySpark SQL

2014-06-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032931#comment-14032931 ] Michael Armbrust commented on SPARK-2010: - I know we merged one PR for this, but

[jira] [Updated] (SPARK-2147) Master UI forgets about Executors when application exits cleanly

2014-06-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2147: - Description: When an application exits cleanly, the Master will remove all executors from the

[jira] [Commented] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

2014-06-16 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033049#comment-14033049 ] DB Tsai commented on SPARK-2100: [~sowen] You are right. The servlet api is pulled by

[jira] [Comment Edited] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

2014-06-16 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033049#comment-14033049 ] DB Tsai edited comment on SPARK-2100 at 6/16/14 9:50 PM: - [~sowen]

[jira] [Comment Edited] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

2014-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033055#comment-14033055 ] Sean Owen edited comment on SPARK-2100 at 6/16/14 9:55 PM: --- Yes,

[jira] [Commented] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

2014-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033055#comment-14033055 ] Sean Owen commented on SPARK-2100: -- Yes, the Maven build has to do a little work to

[jira] [Created] (SPARK-2160) error of Decision tree algorithm in Spark MLlib

2014-06-16 Thread caoli (JIRA)
caoli created SPARK-2160: Summary: error of Decision tree algorithm in Spark MLlib Key: SPARK-2160 URL: https://issues.apache.org/jira/browse/SPARK-2160 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2161) UI should remember executors that have been removed

2014-06-16 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2161: Summary: UI should remember executors that have been removed Key: SPARK-2161 URL: https://issues.apache.org/jira/browse/SPARK-2161 Project: Spark Issue Type: