[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802355#comment-17802355 ] Maytas Monsereenusorn commented on SPARK-30421: --- Not sure if this is the r

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022900#comment-17022900 ] Tobias Hermann commented on SPARK-30421: [~dongjoon] I'm glad we are aligned now

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022850#comment-17022850 ] Dongjoon Hyun commented on SPARK-30421: --- While rethinking about this, the original

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022835#comment-17022835 ] Dongjoon Hyun commented on SPARK-30421: --- Nope. Your example is different. I illust

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022719#comment-17022719 ] Tobias Hermann commented on SPARK-30421: [~dongjoon] No, that's different. To ma

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022715#comment-17022715 ] Tobias Hermann commented on SPARK-30421: [~dongjoon] Thanks, I think that's not

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022694#comment-17022694 ] Dongjoon Hyun commented on SPARK-30421: --- Technically, Python `pandas` follows the

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011941#comment-17011941 ] Tobias Hermann commented on SPARK-30421: It allows you to write code that should

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011930#comment-17011930 ] Wenchen Fan commented on SPARK-30421: - but it will not break anything, right? It jus

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011422#comment-17011422 ] Tobias Hermann commented on SPARK-30421: [~cloud_fan] I think it is an issue bec

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011390#comment-17011390 ] Wenchen Fan commented on SPARK-30421: - is this really an issue? The current semantic

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010271#comment-17010271 ] Takeshi Yamamuro commented on SPARK-30421: -- Based on the current implementation

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010227#comment-17010227 ] Aman Omer commented on SPARK-30421: --- cc [~maropu] > Dropped columns still available f

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008708#comment-17008708 ] Aman Omer commented on SPARK-30421: --- I am panning to add a marker to Project when it i

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008705#comment-17008705 ] Aman Omer commented on SPARK-30421: --- In Analysis planning phase, rule _*ResolveMissing

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008699#comment-17008699 ] Aman Omer commented on SPARK-30421: --- Plans for {code:java} df.drop("bar").where($"bar

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008640#comment-17008640 ] Aman Omer commented on SPARK-30421: --- Thanks [~tobias_hermann] for reporting this issue

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008301#comment-17008301 ] Tobias Hermann commented on SPARK-30421: see:  [https://stackoverflow.com/questi