Liang-Chi Hsieh created SPARK-26551:
---------------------------------------
Summary: Selecting one complex field and having is null predicate
on another complex field can cause error
Key: SPARK-26551
URL: https://issues.apache.org/jira/browse/SPARK-26551
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.0
Reporter: Liang-Chi Hsieh
The query below can cause error when doing schema pruning:
{code:java}
val query = sql("select * from contacts")
.where("name.middle is not null")
.select(
"id",
"name.first",
"name.middle",
"name.last"
)
.where("last = 'Jones'")
.select(count("id")
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
