This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a change to branch release-2.26.0
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 6f9422f [BEAM-11033] Identify Dataflow metrics for portable job path
based on step name. (#13298) (#13299)
add 14d2958 Account for overheads for small/empty PCollections.
add 448d4ea Actually flush batches in rebatch.
add 7ab2677 [BEAM-11249] Read larger chunks for dataframe sources.
add 5c38b6e Require Pandas 1.x for dataframes. (#13323)
add 42725c1 Get writer method from df
new b73141c Merge pull request #13327 [BEAM-11256, 11249, 11253] Various
fixes for Dataframes on Dataflow.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGES.md | 1 +
sdks/python/apache_beam/dataframe/io.py | 17 ++++++------
sdks/python/apache_beam/dataframe/transforms.py | 7 +++--
.../apache_beam/dataframe/transforms_test.py | 32 ++++++++++++++++++++++
sdks/python/container/base_image_requirements.txt | 3 +-
sdks/python/setup.py | 2 +-
6 files changed, 49 insertions(+), 13 deletions(-)
