[GitHub] [spark] dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-03-31 Thread GitBox
dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-606881584 In this PR, you also use `dots` to create the source filter api. This doesn't handle column name

[GitHub] [spark] dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-03-27 Thread GitBox
dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-605389833 @emaynardigs https://github.com/apache/spark/pull/27728 is merged. Are you interested in rebase this

[GitHub] [spark] dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-02-27 Thread GitBox
dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-592256078 A new PR is submitted https://github.com/apache/spark/pull/27728 can you take a look? We can add ORC

[GitHub] [spark] dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-02-14 Thread GitBox
dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-586162885 @emaynardigs I have been distracted by other work, and finally I found some time to continue this

[GitHub] [spark] dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-15 Thread GitBox
dbtsai commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-574826262 Hello @emaynardigs , Thank you for your contribution, and I do value your work a lot. In fact,