[ 
https://issues.apache.org/jira/browse/BEAM-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548060#comment-17548060
 ] 

Danny McCormick commented on BEAM-7624:
---------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/19716

> Missing field support in JsonToRow
> ----------------------------------
>
>                 Key: BEAM-7624
>                 URL: https://issues.apache.org/jira/browse/BEAM-7624
>             Project: Beam
>          Issue Type: Improvement
>          Components: extensions-java-json
>            Reporter: Anton Kedin
>            Priority: P3
>              Labels: Clarified
>
> [JsonToRow|https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/JsonToRow.java]
>  supports only strict schema matching, so it expects all the fields that are 
> declared by the schema to be present in the input JSON data. If the field is 
> missing, [it 
> crashes|https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/util/RowJsonDeserializer.java#L114-L117].
>  In practice it is useful to default to null is such cases. We should make it 
> configurable in Beam Java SDK at least, and probably in Beam SQL (in Pubsub 
> Json TableProvider) as well.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to