[
https://issues.apache.org/jira/browse/SPARK-20798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-20798.
---------------------------------------
Resolution: Fixed
Assignee: Ala Luszczak
Fix Version/s: 2.2.0
2.1.2
> GenerateUnsafeProjection should check if value is null before calling the
> getter
> --------------------------------------------------------------------------------
>
> Key: SPARK-20798
> URL: https://issues.apache.org/jira/browse/SPARK-20798
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Ala Luszczak
> Assignee: Ala Luszczak
> Fix For: 2.1.2, 2.2.0
>
>
> GenerateUnsafeProjection.writeStructToBuffer() does not honor the assumption
> that one should first make sure the value is not null before calling the
> getter. This can lead to errors.
> An example of generated code:
> {noformat}
> /* 059 */ final UTF8String fieldName = value.getUTF8String(0);
> /* 060 */ if (value.isNullAt(0)) {
> /* 061 */ rowWriter1.setNullAt(0);
> /* 062 */ } else {
> /* 063 */ rowWriter1.write(0, fieldName);
> /* 064 */ }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
