[
https://issues.apache.org/jira/browse/BEAM-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alex Van Boxel updated BEAM-9275:
---------------------------------
Description: Introduce the concept of Options in Beam Schema’s to add extra
context to fields and schemas. In contrast to the current Beam metadata that is
present in a FieldType, options would be added to fields, logical types and
schemas. The schema convertors (ex. Avro, Proto, …) can add
options/annotations/decorators that were in the original schema to the Beam
schema with these options. These options, that add contextual metadata, can be
used in the pipeline for specific transformations or augment the end schema in
the target output.
> BIP-1: Beam Schema Options
> --------------------------
>
> Key: BEAM-9275
> URL: https://issues.apache.org/jira/browse/BEAM-9275
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Alex Van Boxel
> Priority: Major
>
> Introduce the concept of Options in Beam Schema’s to add extra context to
> fields and schemas. In contrast to the current Beam metadata that is present
> in a FieldType, options would be added to fields, logical types and schemas.
> The schema convertors (ex. Avro, Proto, …) can add
> options/annotations/decorators that were in the original schema to the Beam
> schema with these options. These options, that add contextual metadata, can
> be used in the pipeline for specific transformations or augment the end
> schema in the target output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
