[
https://issues.apache.org/jira/browse/BEAM-12529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brian Hulette updated BEAM-12529:
---------------------------------
Resolution: Fixed
Status: Resolved (was: Open)
> to_pcollection does not support timestamp types
> -----------------------------------------------
>
> Key: BEAM-12529
> URL: https://issues.apache.org/jira/browse/BEAM-12529
> Project: Beam
> Issue Type: Improvement
> Components: dsl-dataframe
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Fix For: 2.32.0
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> We do not currently support converting timestamps directly from a deferred
> dataframe to a schema'd PCollection. It will raise an error like:
> {code}
> TypeError: Unsupported dtype in proxy: 'datetime64[ns]'
> {code}
> Note that pandas timestamps are nanosecond precision by default, while Beam's
> Timestamp type is microsecond precision.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)