[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369750#comment-16369750 ] Manan Bakshi commented on SPARK-23463: -- Hi Marco, I realized that if you used following code for

[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370917#comment-16370917 ] Manan Bakshi commented on SPARK-23463: -- Hi Marco, That makes sense. However, this same code used to

[jira] [Updated] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi updated SPARK-23463: - Description: I have a simple dataframe with some blank values as below ||dev||val|| |ALL|0.01|

[jira] [Updated] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi updated SPARK-23463: - Description: Filter operations were updated in Spark 2.2.0. Cost Based Optimizer was introduced

[jira] [Created] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

Manan Bakshi created SPARK-23463: Summary: Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition Key: SPARK-23463 URL:

[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368879#comment-16368879 ] Manan Bakshi commented on SPARK-23463: -- I believe that the bug has something to do with CBO that was

[jira] [Updated] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi updated SPARK-23463: - Description: I have a simple dataframe with some blank values as below ||dev||val|| |ALL|0.01|

[jira] [Issue Comment Deleted] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi updated SPARK-23463: - Comment: was deleted (was: I believe that the bug has something to do with CBO that was

[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371864#comment-16371864 ] Manan Bakshi commented on SPARK-23463: -- I will go ahead and resolve this. Thanks!  > Filter

[jira] [Resolved] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi resolved SPARK-23463. -- Resolution: Not A Problem > Filter operation fails to handle blank values and evicts rows that

[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369424#comment-16369424 ] Manan Bakshi commented on SPARK-23463: -- Hi Marco, I have attached a text file along with this

[jira] [Updated] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi updated SPARK-23463: - Attachment: sample > Filter operation fails to handle blank values and evicts rows that even >