[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread stc
Hi dev, We would like raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 35669.

Re:Re: Support SqlStreaming in spark

2018-06-15 Thread stc
The repo you give may solve some of SqlStreaming problems, but not friendly enough, user need to learn this new syntax. -- Jacky Lee Mail:qcsd2...@163.com At 2018-06-15 11:48:01, "Bowden, Chris" wrote: Not sure if there is a question in here, but if you are hinting that structured streami