[
https://issues.apache.org/jira/browse/BEAM-5918?focusedWorklogId=160732&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-160732
]
ASF GitHub Bot logged work on BEAM-5918:
----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Oct/18 16:59
Start Date: 30/Oct/18 16:59
Worklog Time Spent: 10m
Work Description: kanterov commented on issue #6888: [BEAM-5918] [WIP]
Add Cast transform for Rows
URL: https://github.com/apache/beam/pull/6888#issuecomment-434384719
Another approach to the problem would be implementing functional-style
traversals over Schemas and Rows, and implement casting using them. Then they
can be used to implement parsing of "special" fields if needed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 160732)
Time Spent: 3h (was: 2h 50m)
> Add Cast transform for Rows
> ---------------------------
>
> Key: BEAM-5918
> URL: https://issues.apache.org/jira/browse/BEAM-5918
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Gleb Kanterov
> Assignee: Kenneth Knowles
> Priority: Major
> Time Spent: 3h
> Remaining Estimate: 0h
>
> There is a need for a generic transform that given two Row schemas will
> convert rows between them. There must be a possibility to opt-out from
> certain kind of conversions, for instance, converting ints to shorts can
> cause overflow. Another example, a schema could have a nullable field, but
> never have NULL value in practice, because it was filtered out.
> What is needed:
> - widening values (e.g., int -> long)
> - narrowwing (e.g., int -> short)
> - runtime check for overflow while narrowing
> - ignoring nullability (nullable=true -> nullable=false)
> - weakening nullability (nullable=false -> nullable=true)
> - projection (Schema(a: Int32, b: Int32) -> Schema(a: Int32))
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
