[
https://issues.apache.org/jira/browse/SPARK-57573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-57573:
-----------------------------
Description:
h2. What
Support {{TimeType}} <-> Protobuf conversion in the protobuf connector
(from_protobuf /
to_protobuf), matching the Avro support (SPARK-54473).
h2. Gap
connector/protobuf/.../utils/SchemaConverters.scala has no {{TimeType}} /
{{LocalTime}} mapping.
h2. Scope
* Choose the Protobuf representation (e.g. an int64 nanos/micros-of-day field,
or
google.type.TimeOfDay) and map {{TimeType}} <-> it in SchemaConverters, the
serializer, and
the deserializer.
* Document the mapping and any precision constraints.
h2. Acceptance criteria
* Round-trip of TIME columns through to_protobuf/from_protobuf preserves values.
* Tests added in the protobuf connector suites.
> Support the TIME data type in the Protobuf connector
> ----------------------------------------------------
>
> Key: SPARK-57573
> URL: https://issues.apache.org/jira/browse/SPARK-57573
> Project: Spark
> Issue Type: Sub-task
> Components: Protobuf
> Affects Versions: 4.3.0
> Reporter: Max Gekk
> Priority: Major
>
> h2. What
> Support {{TimeType}} <-> Protobuf conversion in the protobuf connector
> (from_protobuf /
> to_protobuf), matching the Avro support (SPARK-54473).
> h2. Gap
> connector/protobuf/.../utils/SchemaConverters.scala has no {{TimeType}} /
> {{LocalTime}} mapping.
> h2. Scope
> * Choose the Protobuf representation (e.g. an int64 nanos/micros-of-day
> field, or
> google.type.TimeOfDay) and map {{TimeType}} <-> it in SchemaConverters, the
> serializer, and
> the deserializer.
> * Document the mapping and any precision constraints.
> h2. Acceptance criteria
> * Round-trip of TIME columns through to_protobuf/from_protobuf preserves
> values.
> * Tests added in the protobuf connector suites.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
