[jira] [Created] (BEAM-12529) to_pcollection does not support timestamp types

[Brian Hulette (Jira)]

Brian Hulette created BEAM-12529:
------------------------------------

             Summary: to_pcollection does not support timestamp types
                 Key: BEAM-12529
                 URL: https://issues.apache.org/jira/browse/BEAM-12529
             Project: Beam
          Issue Type: Improvement
          Components: dsl-dataframe
            Reporter: Brian Hulette


We do not currently support converting timestamps directly from a deferred 
dataframe to a schema'd PCollection. It will raise an error like:

{code}
TypeError: Unsupported dtype in proxy: 'datetime64[ns]'
{code}

Note that pandas timestamps are nanosecond precision by default, while Beam's 
Timestamp type is microsecond precision.





--
This message was sent by Atlassian Jira
(v8.3.4#803005)