On Wed, 23 Jun 2021 07:37:09 -0500
Wes McKinney wrote:
> On Wed, Jun 23, 2021 at 3:03 AM Antoine Pitrou wrote:
> >
> > On Tue, 22 Jun 2021 19:04:49 -0500
> > Wes McKinney wrote:
> > > Some on this list might be interested in a new paper out of CMU/MIT
> > > about the use of selection vectors a
On Wed, Jun 23, 2021 at 3:03 AM Antoine Pitrou wrote:
>
> On Tue, 22 Jun 2021 19:04:49 -0500
> Wes McKinney wrote:
> > Some on this list might be interested in a new paper out of CMU/MIT
> > about the use of selection vectors and bitmaps for handling the
> > intermediate results of filters:
> >
>
On Tue, 22 Jun 2021 19:04:49 -0500
Wes McKinney wrote:
> Some on this list might be interested in a new paper out of CMU/MIT
> about the use of selection vectors and bitmaps for handling the
> intermediate results of filters:
>
> https://db.cs.cmu.edu/papers/2021/ngom-damon2021.pdf
>
> The resea
Thank you for sharing, Wes, an interesting paper indeed.
In Rust we currently use a different strategy.
We build an iterator over ranges [a_i, b_i[ to be selected from the
filter bitmap, and filter the array based on those ranges. For a
single filter, the ranges are iterated as they are being bui
Some on this list might be interested in a new paper out of CMU/MIT
about the use of selection vectors and bitmaps for handling the
intermediate results of filters:
https://db.cs.cmu.edu/papers/2021/ngom-damon2021.pdf
The research was done in the context of NoisePage which uses Arrow as
its memor
