wombatu-kun commented on issue #11348: URL: https://github.com/apache/hudi/issues/11348#issuecomment-2246907088
> I decided to stop trying to upsert with Hudi Streamer and rewrote everything to Spark. > > But I still hope that the Hudi Streamer will be fixed, since this is the simplest and low-code way to stream to Hudi sources. hi, @kirillklimenko! Did you try setting payload class for Hudi Streamer not in `hoodie.properties` file, but in spark-submit argument `--payload-class`? (as you set --source-ordering-field and --transformer-class). As I see from code, default value of config `HoodieStreamer.Config.payloadClassName` is `OverwriteWithLatestAvroPayload`. And this value is used to build HoodieWriteConfig. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
