[jira] [Created] (SPARK-1796) spark-submit does not set driver memory correctly

2014-05-11 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1796: -- Summary: spark-submit does not set driver memory correctly Key: SPARK-1796 URL: https://issues.apache.org/jira/browse/SPARK-1796 Project: Spark Issue

[jira] [Updated] (SPARK-571) Forbid return statements when cleaning closures

2014-05-11 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-571: -- Description: By mistake, I wrote some code like this: {code} object Foo { def main() { val sc = new

[jira] [Updated] (SPARK-1764) EOF reached before Python server acknowledged

2014-05-11 Thread Bouke van der Bijl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bouke van der Bijl updated SPARK-1764: -- Description: I'm getting EOF reached before Python server acknowledged while using

[jira] [Commented] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

2014-05-11 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992985#comment-13992985 ] Nishkam Ravi commented on SPARK-1758: - Keeping only pull request 692 open. failing

[jira] [Created] (SPARK-1797) streaming on hdfs can detected all new file, but the sum of all the rdd.count() not equals which had detected

2014-05-11 Thread QingFeng Zhang (JIRA)
QingFeng Zhang created SPARK-1797: - Summary: streaming on hdfs can detected all new file, but the sum of all the rdd.count() not equals which had detected Key: SPARK-1797 URL:

[jira] [Updated] (SPARK-1797) streaming on hdfs can detected all new file, but the sum of all the rdd.count() not equals which had detected

2014-05-11 Thread QingFeng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QingFeng Zhang updated SPARK-1797: -- Description: when I put 200 png files to Hdfs , I found sparkStreaming counld detect 200

[jira] [Updated] (SPARK-1797) streaming on hdfs can detected all new file, but the sum of all the rdd.count() not equals which had detected

2014-05-11 Thread QingFeng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QingFeng Zhang updated SPARK-1797: -- Description: when I put 200 png files to Hdfs , I found sparkStreaming counld detect 200

[jira] [Updated] (SPARK-1797) streaming on hdfs can detected all new file, but the sum of all the rdd.count() not equals which had detected

2014-05-11 Thread QingFeng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QingFeng Zhang updated SPARK-1797: -- Component/s: Spark Core Input/Output streaming on hdfs can detected all new

[jira] [Comment Edited] (SPARK-1764) EOF reached before Python server acknowledged

2014-05-11 Thread Bouke van der Bijl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992994#comment-13992994 ] Bouke van der Bijl edited comment on SPARK-1764 at 5/8/14 6:30 PM:

[jira] [Updated] (SPARK-1470) Use the scala-logging wrapper instead of the directly sfl4j api

2014-05-11 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1470: --- Fix Version/s: 1.1.0 Use the scala-logging wrapper instead of the directly sfl4j api

[jira] [Commented] (SPARK-1755) Spark-submit --name does not resolve to application name on YARN

2014-05-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992495#comment-13992495 ] Andrew Or commented on SPARK-1755: -- SPARK-1631 is concerned with fixing the case in which

[jira] [Created] (SPARK-1799) Add init script to the debian packaging

2014-05-11 Thread JIRA
Nicolas Lalevée created SPARK-1799: -- Summary: Add init script to the debian packaging Key: SPARK-1799 URL: https://issues.apache.org/jira/browse/SPARK-1799 Project: Spark Issue Type: New

[jira] [Created] (SPARK-1764) EOF reached before Python server acknowledged

2014-05-11 Thread Bouke van der Bijl (JIRA)
Bouke van der Bijl created SPARK-1764: - Summary: EOF reached before Python server acknowledged Key: SPARK-1764 URL: https://issues.apache.org/jira/browse/SPARK-1764 Project: Spark Issue

[jira] [Resolved] (SPARK-1770) repartition and coalesce(shuffle=true) put objects with the same key in the same bucket

2014-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1770. Resolution: Fixed repartition and coalesce(shuffle=true) put objects with the same key in

[jira] [Created] (SPARK-1801) Open up sime private APIs related to creating new RDDs for developers

2014-05-11 Thread koert kuipers (JIRA)
koert kuipers created SPARK-1801: Summary: Open up sime private APIs related to creating new RDDs for developers Key: SPARK-1801 URL: https://issues.apache.org/jira/browse/SPARK-1801 Project: Spark

[jira] [Commented] (SPARK-1750) EdgePartition is not serialized properly

2014-05-11 Thread Joseph E. Gonzalez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994766#comment-13994766 ] Joseph E. Gonzalez commented on SPARK-1750: --- I believe this issue is resolved

[jira] [Resolved] (SPARK-1565) Spark examples should be changed given spark-submit

2014-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1565. Resolution: Fixed Issue resolved by pull request 552

[jira] [Commented] (SPARK-1765) Modify a typo in monitoring.md

2014-05-11 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992992#comment-13992992 ] Kousuke Saruta commented on SPARK-1765: --- I've pull-requested for PR-698. Modify a

[jira] [Updated] (SPARK-1774) SparkSubmit --jars not working for yarn-client

2014-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1774: --- Assignee: Andrew Or SparkSubmit --jars not working for yarn-client

[jira] [Comment Edited] (SPARK-1792) Missing Spark-Shell Configure Options

2014-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994800#comment-13994800 ] Patrick Wendell edited comment on SPARK-1792 at 5/12/14 4:49 AM:

[jira] [Comment Edited] (SPARK-1760) mvn -Dsuites=* test throw an ClassNotFoundException

2014-05-11 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992873#comment-13992873 ] Guoqiang Li edited comment on SPARK-1760 at 5/8/14 4:05 PM:

[jira] [Comment Edited] (SPARK-1792) Missing Spark-Shell Configure Options

2014-05-11 Thread Joseph E. Gonzalez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994809#comment-13994809 ] Joseph E. Gonzalez edited comment on SPARK-1792 at 5/12/14 5:08 AM:

[jira] [Commented] (SPARK-1792) Missing Spark-Shell Configure Options

2014-05-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994803#comment-13994803 ] Andrew Or commented on SPARK-1792: -- Spark shell calls spark submit, which loads

[jira] [Issue Comment Deleted] (SPARK-1792) Missing Spark-Shell Configure Options

2014-05-11 Thread Joseph E. Gonzalez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph E. Gonzalez updated SPARK-1792: -- Comment: was deleted (was: We might want to resolve this with the 1.0 release @matei