sydneybeal opened a new pull request, #7913: URL: https://github.com/apache/hudi/pull/7913
### Change Logs Adding support for EPOCHMICROSECONDS in TimestampBasedAvroKeyGenerator ### Impact Users can pass value EPOCHMICROSECONDS to config hoodie.deltastreamer.keygen.timebased.timestamp.type, key gen field is parsed into the correct partitions i.e. yyyy/mm/dd ### Risk level (write none, low medium or high below) Low For testing I created a jar locally with hudi-utilities-bundle_2.12-0.12.2 with my code change and substituted it in my Spark job - it worked as planned, microsecond timestamps are being partitioned as expected now. Running Google Dataproc Hudi Deltastreamer job, reading from Confluent Cloud Debezium Avro Kafka topic, writing Hudi outputs to S3. ### Documentation Update _Describe any necessary documentation update if there is any new feature, config, or user-facing change_ This would require an update to the keygen timestamp.type in the documentation to include EPOCHMICROSECONS in [this section of the documentation](https://hudi.apache.org/blog/2021/02/13/hudi-key-generators/#timestampbasedkeygenerator) ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Change Logs and Impact were stated clearly - [] Adequate tests were added if applicable - [] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
