nathaniel-d-ef opened a new pull request, #8371: URL: https://github.com/apache/arrow-rs/pull/8371
# Which issue does this PR close? - Part of https://github.com/apache/arrow-rs/issues/4886 - Extends work in https://github.com/apache/arrow-rs/pull/8242 # Rationale for this change This introduces writer-side fingerprint prefix support, removing the existing hard-coded Rabin approach with a configurable pattern extending off of the work done on the reader side. In addition to supporting the SHA256 and MD5 (feature flagged), we also cover compatibility with Confluent's wire format IDs. # What changes are included in this PR? - Adds support for SHA256 and MD5 algorithm types and Confluent IDs in the writer. Rabin remains the default. # Are these changes tested? Yes, existing tests are all passing, and tests have been added to validate the prefix outputs. Benchmark results show no appreciable changes. # Are there any user-facing changes? - `confluent.schema.id` is the expected value in the schema metadata for the writer to apply the correct magic byte. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
