[
https://issues.apache.org/jira/browse/HUDI-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin closed HUDI-5254.
---------------------------------
Resolution: Fixed
After careful review this doesn't seem to actually be an issue, since we're
caching the parsed schemas and therefore not doing it for every record
> Revisit ExpressionPayload to avoid parsing Avro schemas for every record
> ------------------------------------------------------------------------
>
> Key: HUDI-5254
> URL: https://issues.apache.org/jira/browse/HUDI-5254
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark-sql
> Reporter: Alexey Kudinkin
> Assignee: Jonathan Vexler
> Priority: Blocker
> Fix For: 0.13.0
>
>
> Currently ExpressionPayload, parses writer/reader schema for every record.
> Instead we should use broadcast vars to avoid doing that for every record,
> and instead do it per executor
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
