Hi Daniel, There is no way to avoid storing/writing to the bitmap in Java API. If you know your data is never null you can likely prepopulate the buffers directly which would save quite a bit of time.
To avoid checks of the validity bitmap when accessing elements you set an environment variable/system property that will avoid the extra null check on access. It is covered in the Java readme [1]. -Micah [1] https://github.com/apache/arrow/tree/master/java#performance-tuning On Fri, Oct 1, 2021 at 10:00 AM Daniel Hsu <[email protected]> wrote: > Hi All, > > I'm developing a Java application using Arrow, and I'm wondering if there > is a way to entirely avoid storing, writing to, and checking against, the > validity bitmap. > > My datasets are guaranteed to never contain nulls, and from my performance > test flame graphs I believe I can save a lot by avoid storing and > interacting with the validity bitmap entirely. > > Best, > Daniel >
