[jira] [Created] (SPARK-15843) Spark RAM issue

Sreetej Lakkam created SPARK-15843: -- Summary: Spark RAM issue Key: SPARK-15843 URL: https://issues.apache.org/jira/browse/SPARK-15843 Project: Spark Issue Type: Question

[jira] [Resolved] (SPARK-15843) Spark RAM issue

[ https://issues.apache.org/jira/browse/SPARK-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15843. --- Resolution: Invalid Target Version/s: (was: 1.6.1) Please read

[jira] [Commented] (SPARK-11765) Avoid assign UI port between browser unsafe ports (or just 4045: lockd)

[ https://issues.apache.org/jira/browse/SPARK-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322503#comment-15322503 ] Willy Lee commented on SPARK-11765: --- The problem as I see it is that 4045 is an unused port on most

[jira] [Commented] (SPARK-11765) Avoid assign UI port between browser unsafe ports (or just 4045: lockd)

[ https://issues.apache.org/jira/browse/SPARK-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322453#comment-15322453 ] Willy Lee commented on SPARK-11765: --- I'm sorry, I must not have been clear. I think it's broken

[jira] [Updated] (SPARK-15842) Add support for socket stream.

[ https://issues.apache.org/jira/browse/SPARK-15842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-15842: Description: Streaming so far has offset based sources with all the available sources like

[jira] [Comment Edited] (SPARK-15801) spark-submit --num-executors switch also works without YARN

[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322322#comment-15322322 ] Jonathan Taws edited comment on SPARK-15801 at 6/9/16 1:08 PM: --- I don't

[jira] [Comment Edited] (SPARK-15801) spark-submit --num-executors switch also works without YARN

[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322322#comment-15322322 ] Jonathan Taws edited comment on SPARK-15801 at 6/9/16 1:08 PM: --- I don't

[jira] [Issue Comment Deleted] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15716: -- Comment: was deleted (was: [~yani.chen] the problem is you've described several different problems,

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322942#comment-15322942 ] Sean Owen commented on SPARK-15716: --- [~yani.chen] the problem is you've described several different

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322938#comment-15322938 ] Sean Owen commented on SPARK-15716: --- [~yani.chen] the problem is you've described several different

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322950#comment-15322950 ] Yan Chen commented on SPARK-15716: -- Does it mean if we can not identify what the problem is, we should

[jira] [Resolved] (SPARK-15827) Publish Spark's forked sbt-pom-reader to Maven Central

[ https://issues.apache.org/jira/browse/SPARK-15827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-15827. Resolution: Fixed Fix Version/s: 2.0.0 1.6.2 Fixed by my patch for

[jira] [Commented] (SPARK-15848) Spark unable to read partitioned table in avro format and column name in upper case

[ https://issues.apache.org/jira/browse/SPARK-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323195#comment-15323195 ] Zhan Zhang commented on SPARK-15848: cat > file1.csv< file2.csv< val tbl =

[jira] [Assigned] (SPARK-15844) HistoryServer doesn't come up if spark.authenticate = true

[ https://issues.apache.org/jira/browse/SPARK-15844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15844: Assignee: (was: Apache Spark) > HistoryServer doesn't come up if spark.authenticate =

[jira] [Assigned] (SPARK-15844) HistoryServer doesn't come up if spark.authenticate = true

[ https://issues.apache.org/jira/browse/SPARK-15844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15844: Assignee: Apache Spark > HistoryServer doesn't come up if spark.authenticate = true >

[jira] [Commented] (SPARK-15844) HistoryServer doesn't come up if spark.authenticate = true

[ https://issues.apache.org/jira/browse/SPARK-15844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322793#comment-15322793 ] Apache Spark commented on SPARK-15844: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-15828) YARN is not aware of Spark's External Shuffle Service

[ https://issues.apache.org/jira/browse/SPARK-15828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322827#comment-15322827 ] Miles Crawford commented on SPARK-15828: Possibly could happen without dynamic allocation, but if

[jira] [Commented] (SPARK-15828) YARN is not aware of Spark's External Shuffle Service

[ https://issues.apache.org/jira/browse/SPARK-15828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322865#comment-15322865 ] Saisai Shao commented on SPARK-15828: - I see, but I don't clearly understand your scenario, are the

[jira] [Updated] (SPARK-15845) Expose metrics for sub-task transformations and action

[ https://issues.apache.org/jira/browse/SPARK-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-15845: Summary: Expose metrics for sub-task transformations and action (was: Expose metrics for

[jira] [Updated] (SPARK-15845) Expose metrics for sub-stage transformations and action

[ https://issues.apache.org/jira/browse/SPARK-15845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-15845: Summary: Expose metrics for sub-stage transformations and action (was: Expose metrics for

[jira] [Created] (SPARK-15845) Expose metrics for sub-task steps

nirav patel created SPARK-15845: --- Summary: Expose metrics for sub-task steps Key: SPARK-15845 URL: https://issues.apache.org/jira/browse/SPARK-15845 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-15804) Manually added metadata not saving with parquet

[ https://issues.apache.org/jira/browse/SPARK-15804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15804: Assignee: kevin yu > Manually added metadata not saving with parquet >

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322857#comment-15322857 ] Peter Halliday commented on SPARK-14560: Is this going to be in 1.6.2 too? Is there a timeline

[jira] [Commented] (SPARK-15828) YARN is not aware of Spark's External Shuffle Service

[ https://issues.apache.org/jira/browse/SPARK-15828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322876#comment-15322876 ] Miles Crawford commented on SPARK-15828: This is Hadoop's standard means of resizing a cluster.

[jira] [Created] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

Xiao Li created SPARK-15838: --- Summary: CACHE TABLE AS SELECT should not replace the existing Temp Table Key: SPARK-15838 URL: https://issues.apache.org/jira/browse/SPARK-15838 Project: Spark

[jira] [Assigned] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

[ https://issues.apache.org/jira/browse/SPARK-15838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15838: Assignee: Apache Spark > CACHE TABLE AS SELECT should not replace the existing Temp Table

[jira] [Assigned] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

[ https://issues.apache.org/jira/browse/SPARK-15838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15838: Assignee: (was: Apache Spark) > CACHE TABLE AS SELECT should not replace the existing

[jira] [Commented] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

[ https://issues.apache.org/jira/browse/SPARK-15838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322005#comment-15322005 ] Apache Spark commented on SPARK-15838: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322039#comment-15322039 ] Miao Wang commented on SPARK-15545: --- [~shivaram]Thanks for your clarification. I will start working on

<    1   2   3