[jira] [Commented] (SPARK-22616) df.cache() / df.persist() should have an option blocking like df.unpersist()

2017-11-28 Thread Andreas Maier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268530#comment-16268530 ] Andreas Maier commented on SPARK-22616: --- Ok, I understand your point now. You were thinking in

[jira] [Commented] (SPARK-22616) df.cache() / df.persist() should have an option blocking like df.unpersist()

2017-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267017#comment-16267017 ] Sean Owen commented on SPARK-22616: --- The method signature becomes different in the Java bytecode. Try

[jira] [Commented] (SPARK-22616) df.cache() / df.persist() should have an option blocking like df.unpersist()

2017-11-27 Thread Andreas Maier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266995#comment-16266995 ] Andreas Maier commented on SPARK-22616: --- I don't see how simply adding an option "blocking" with

[jira] [Commented] (SPARK-22616) df.cache() / df.persist() should have an option blocking like df.unpersist()

2017-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266920#comment-16266920 ] Sean Owen commented on SPARK-22616: --- I do see this come up so much that I think it's a valid feature