Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22357
FYI, per further checking code and discussion with @dbtsai regarding with
predicate pushdown, we know that predicate push down only works for primitive
types on Parquet datasource. So both `IsNotNull(employer)` and
`IsNotNull(employer.id)` are not actually pushed down to work at Parquet reader.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
