[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2018-01-04 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312499#comment-16312499 ] Imran Rashid commented on SPARK-22805: -- I'm leaning slightly against this, though could go either

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-18 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295328#comment-16295328 ] Marcelo Vanzin commented on SPARK-22805: Is the question about compatibility? There's none, it's

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295017#comment-16295017 ] Sean Owen commented on SPARK-22805: --- Yes, it's not forwards-compatible. Hm. I don't think we would

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-18 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294745#comment-16294745 ] Sergei Lebedev commented on SPARK-22805: It does, in a sense that 1.6 history server can no

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-18 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294727#comment-16294727 ] Anthony Truchet commented on SPARK-22805: - As I understand it does not break any standard use and

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-17 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294230#comment-16294230 ] Sergei Lebedev commented on SPARK-22805: It doesn't save much storage if block updates tracking

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294197#comment-16294197 ] Sean Owen commented on SPARK-22805: --- OK, are you saying this doesn't save much storage? if not, may not

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-16 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293836#comment-16293836 ] Sergei Lebedev commented on SPARK-22805: I've emulated the effect of SPARK-20923 by removing all

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-15 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293369#comment-16293369 ] Sergei Lebedev commented on SPARK-22805: After some investigation, it turns out that the majority

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292876#comment-16292876 ] Apache Spark commented on SPARK-22805: -- User 'superbobry' has created a pull request for this issue:

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-15 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292848#comment-16292848 ] Sergei Lebedev commented on SPARK-22805: Here're results for a single application with 6K

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-15 Thread Sergei Lebedev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292758#comment-16292758 ] Sergei Lebedev commented on SPARK-22805: I have a patch which preserves backward compatibility.

[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292742#comment-16292742 ] Sean Owen commented on SPARK-22805: --- The current format is somewhat more flexible but yes it's verbose.