auroflow opened a new pull request, #29469: URL: https://github.com/apache/flink/pull/29469
## What is the purpose of the change Add `map` and `map_batches` transformations to the PyFlink DataFrame API. ## Brief change log - Add `DataFrame.map` and `DataFrame.map_batches`, supporting functions, callable classes and instances, and DataFrame UDF declarations. - Add input schemas and result normalization helpers for `map` and `map_batches`. - Extend `Table.map` to asynchronous scalar functions to allow async map calls. - Add API reference entries, usage examples, and planner, adapter, coder, and integration coverage. ## Verifying this change This change adds and extends tests for declaration reuse and lifecycle, synchronous/asynchronous row maps, pandas/Arrow batch maps, invalid outputs, row order, and mixed transformation pipelines. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): no. - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: yes; adds DataFrame transformation methods and extends Python `Table.map` to asynchronous scalar functions. - The serializers: yes; extends internal Python UDF/coder descriptors and pandas Arrow result conversion. - The runtime per-record code paths (performance sensitive): yes; adds row-map adapters and extends Python batch result handling. - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no. - The S3 file system connector: no. ## Documentation - Does this pull request introduce a new feature? yes. - If yes, how is the feature documented? docs; DataFrame API reference entries and method docstrings with examples and input/output contracts. --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes (please specify the tool below) Generated-by: Codex (GPT-6) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
