Upgrading to 6.0.X I noticed that record batches can have body compression
which I think is great.

I had trouble finding examples in python or R (or java) of writing an IPC
file with various types of compression used for the record batch.

Is the compression applied per-column or upon the record batch after the
buffers have been serialized to the batch?  If it is applied per column
which buffers - given that text for example can consist of 3 buffers
(validity, offset, data) is compression applied to all three or just data
or data and offset?

Reply via email to