dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-607021780
For the worst case, we don't see extra overhead from parquet side.
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-60700
It really depends on the data and if we can skip most of the row
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-605390464
Ping @MaxGekk , are you interested in working on ORC version of it?
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-605389730
Thank you, @cloud-fan @HyukjinKwon @rdblue @viirya @dongjoon-hyun
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-604278610
Retest this please.
dbtsai commented on issue #27728:
[SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested
Column Predicate Pushdown for Parquet
URL: https://github.com/apache/spark/pull/27728#issuecomment-603071682
Jenkins, test this again.