barunkumaracharya opened a new issue, #38820: URL: https://github.com/apache/beam/issues/38820
### What would you like to happen? In Beam's latest release 2.74.0, Hash Distribution Mode and AutoSharding were enabled via this [PR 38061](https://github.com/apache/beam/pull/38061). This PR introduced a new transform WriteToPartitions (file WriteToPartitions.java, new in 2.74.0) and this file uses GroupIntoBatches Transform which is not supported in Spark Runners as Spark Runner does not support **@OnWindowExpiration** annotation (States and Timers) which is why i m unable to use the new feature in Spark Runner. Is there a workaround or solve for Spark Runner Users to use the "hash" distribution mode with "autoSharding" for Iceberg Writes using Beam. ### Issue Priority Priority: 2 (default / most feature requests should be filed as P2) ### Issue Components - [ ] Component: Python SDK - [x] Component: Java SDK - [ ] Component: Go SDK - [ ] Component: Typescript SDK - [ ] Component: IO connector - [ ] Component: Beam YAML - [ ] Component: Beam examples - [ ] Component: Beam playground - [ ] Component: Beam katas - [ ] Component: Website - [ ] Component: Infrastructure - [ ] Component: Spark Runner - [ ] Component: Flink Runner - [ ] Component: Prism Runner - [ ] Component: Twister2 Runner - [ ] Component: Hazelcast Jet Runner - [ ] Component: Google Cloud Dataflow Runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
