Github user viirya commented on the issue:
https://github.com/apache/spark/pull/13439
@kiszk
1. The allocation mechanism is not changed in this patch. Just for the
column vector representing partition columns and null columns, this patch only
allocates 1 row.
2. I think the speed-up might come from simplified memory access. Because
we don't need to scan the memory space for all values. For the constant column
vectors, only one value is accessed. I don't know if elimination of index bound
helps or not. I will try to do that in `OnHeapColumnVector` and benchmark them
again to see the difference.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
