[
https://issues.apache.org/jira/browse/BEAM-6701?focusedWorklogId=199798&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-199798
]
ASF GitHub Bot logged work on BEAM-6701:
----------------------------------------
Author: ASF GitHub Bot
Created on: 17/Feb/19 18:59
Start Date: 17/Feb/19 18:59
Worklog Time Spent: 10m
Work Description: reuvenlax commented on pull request #7865: [BEAM-6701]
Add logical types to schema
URL: https://github.com/apache/beam/pull/7865
Beam schemas define a limited number of fundamental types, and often users
of schemas have slightly different needs for field types. An example is Beam
SQL: SQL has many different date/time/timestamp types, while Beam has only the
one DATETIME field type. Today SQL stuffs magic strings into the FieldType
metadata to identify _which_ type it is really using, which is quite ad hoc.
Logical types introduce a principled way of doing this. A new LogicalType
class can be defined that uses one of the fundamental Beam field types as
storage. The user can then add this logical type to their schema, and Beam will
use the underlying field type and record the logical type in the field as well.
Logical types have globally unique identifiers that are understood by the
system, so this provides a much more principled way of storing custom types in
schemas.
This PR adds LogicalType and converts Avro and Beam SQL over to the new
framework. Follow-on PRs will add CoderLogicalType (so any existing Coder can
be used as a Schema field) as well as adding logical-type support to POJOs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 199798)
Time Spent: 10m
Remaining Estimate: 0h
> Create LogicalType for Schema fields
> ------------------------------------
>
> Key: BEAM-6701
> URL: https://issues.apache.org/jira/browse/BEAM-6701
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-java-core
> Reporter: Reuven Lax
> Assignee: Reuven Lax
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> This will allow users to create their own logical types to store in schema
> fields, backed by one of the fundamental schema field types. Today SQL hacks
> on top of the field metadata to distinguish its types. LogicalTypes would
> allow for a more principled way of doing this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
