[
https://issues.apache.org/jira/browse/PARQUET-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue resolved PARQUET-341.
-------------------------------
Resolution: Fixed
Fix Version/s: 1.9.0
This was fixed by #247.
> Improve write performance with wide schema sparse data
> ------------------------------------------------------
>
> Key: PARQUET-341
> URL: https://issues.apache.org/jira/browse/PARQUET-341
> Project: Parquet
> Issue Type: Improvement
> Reporter: Tianshuo Deng
> Assignee: Tianshuo Deng
> Fix For: 1.9.0
>
>
> In write path, when there are tons of sparse data, most of time is spent on
> writing nulls.
> Currently writing nulls has the same code path as writing values, which is
> reclusive traverse all the leaves when a group is null.
> Due to the fact that when a group is null all the leaves beneath it should be
> written with null value with the same repetition level and definition level,
> we can eliminate the recursion call to get the leaves
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
