+1 binding. very excited. On Wed, Feb 25, 2026 at 10:47 PM John Zhuge <[email protected]> wrote:
> +1 (non-binding) Appreciate it! > > On Wed, Feb 25, 2026 at 4:13 PM karuppayya <[email protected]> > wrote: > >> +1 (non-binding) >> >> On Wed, Feb 25, 2026 at 3:48 PM Qiegang Long <[email protected]> wrote: >> >>> +1 non-binding >>> >>> On Wed, Feb 25, 2026 at 6:42 PM L. C. Hsieh <[email protected]> wrote: >>> >>>> +1 >>>> >>>> On Wed, Feb 25, 2026 at 2:45 PM Gengliang Wang <[email protected]> >>>> wrote: >>>> >>>>> Hi Spark devs, >>>>> >>>>> I'd like to call a vote on the SPIP*: DSV2 Enhanced Partition Stats >>>>> Filtering.* >>>>> >>>>> *Summary:* >>>>> >>>>> The DataSource V2 (DSV2) framework does not currently provide full >>>>> data-skipping capabilities comparable to Spark-native sources, primarily >>>>> due to limitations in Catalyst expression evaluation. >>>>> >>>>> This SPIP bridges that gap to achieve partition-skipping parity. To >>>>> support this, Spark will push new *PartitionPredicate* objects that >>>>> encapsulate Catalyst partition filter expressions and the evaluation >>>>> logic, >>>>> allowing data sources to skip irrelevant partitions effectively. >>>>> >>>>> *Relevant Links:* >>>>> >>>>> - >>>>> >>>>> - *SPIP Doc:* >>>>> >>>>> https://docs.google.com/document/d/17vcw411PxSRLWoK-BiLI56UiNdokLWtovF8JZUlDTOo/edit?usp=sharing >>>>> - >>>>> >>>>> *Discuss Thread:* >>>>> https://lists.apache.org/thread/p2cwngj9bmtcbmyplds833s9lwts8bwc >>>>> - >>>>> >>>>> *JIRA:* SPARK-55596 >>>>> <https://issues.apache.org/jira/browse/SPARK-55596> >>>>> - >>>>> >>>>> *POC PR:* PR 54459 <https://github.com/apache/spark/pull/54459> >>>>> >>>>> *The vote will be open for at least 72 hours. *Please vote: >>>>> >>>>> [ ] +1: Accept the proposal as an official SPIP >>>>> >>>>> [ ] +0 >>>>> >>>>> [ ] -1: I don't think this is a good idea because ... >>>>> >>>>> Thanks, >>>>> Gengliang Wang >>>>> >>>>> > > -- > John Zhuge >
