Hi, everyone - In v4, we introduced the notion of *tightness* in stats. Tightness indicates whether the upper/lower bounds truly exist in the live rows of a file. If the stats are tight, then engines can correctly answer many queries purely by consulting the metadata.
However, when a DV is attached to a file, the stats are assumed to be non-tight, so these metadata-only query optimizations won't work anymore. So we want a way to represent stats tightness even in the presence of a DV. I have a short writeup <https://docs.google.com/document/d/13DbwnwKQXjvY3vRcFJo-qVAQWk-GB4zLzzYmFdPntZg/edit?tab=t.0> of the problem and a few possible solutions. We discussed this today at the v4 adaptive metadata tree sync, and I wanted to continue the discussion. Please take a look at the doc <https://docs.google.com/document/d/13DbwnwKQXjvY3vRcFJo-qVAQWk-GB4zLzzYmFdPntZg/edit?tab=t.0#heading=h.9cvri5ibsn4r> and let us know what you think by leaving a comment in the doc or in this email thread. Best, Anoop
