[ 
https://issues.apache.org/jira/browse/BEAM-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17121943#comment-17121943
 ] 

Kenneth Knowles commented on BEAM-7921:
---------------------------------------

This issue is assigned but has not received an update in 30 days so it has been 
labeled "stale-assigned". If you are still working on the issue, please give an 
update and remove the label. If you are no longer working on the issue, please 
unassign so someone else may work on it. In 7 days the issue will be 
automatically unassigned.

> Add Schema support for Tensorflow
> ---------------------------------
>
>                 Key: BEAM-7921
>                 URL: https://issues.apache.org/jira/browse/BEAM-7921
>             Project: Beam
>          Issue Type: Improvement
>          Components: dsl-sql, io-java-tfrecord
>    Affects Versions: 2.14.0
>            Reporter: Neville Li
>            Assignee: Tarush Grover
>            Priority: P2
>              Labels: stale-assigned
>
> Similar to BEAM-5807, Tensorflow's defacto storage format is {{TFRecord}} 
> files with {{Example}} proto payload and its own schema.proto. We already 
> have {{TFRecordIO}} support. Need to implement:
>  * Conversion between Beam and TF schema
>  * Conversion between Beam Row and TF Example proto
>  * {{TFRecordTableProvider}}
> [https://github.com/tensorflow/metadata/blob/master/tensorflow_metadata/proto/v0/schema.proto]
> [https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/example/example.proto]
>  
> Also it seems the metadata protos are not published as Java artifacts:
> [https://github.com/tensorflow/metadata/issues/5]
> My WIP branch: https://github.com/spotify/beam/tree/neville/tf



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to