[
https://issues.apache.org/jira/browse/BEAM-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371479#comment-17371479
]
Brian Hulette commented on BEAM-12131:
--------------------------------------
Note that unrecognized pandas dtypes (including datetime64) are just passed
through as-is with typehint "Any" (see
https://github.com/apache/beam/pull/15073). We should define a mechanism for
mapping this type to a Beam timestamp as part of this work.
> DataFrame API: Integrate pandas windowing with Beam event-time semantics
> ------------------------------------------------------------------------
>
> Key: BEAM-12131
> URL: https://issues.apache.org/jira/browse/BEAM-12131
> Project: Beam
> Issue Type: Improvement
> Components: dsl-dataframe, sdk-py-core
> Reporter: Brian Hulette
> Priority: P2
> Labels: dataframe-api
>
> pandas has support for
> [rolling()|https://pandas.pydata.org/pandas-docs/stable/user_guide/window.html]
> windows. It should be possible to use this within a DataframeTransform and
> have it apply Beam windowing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
