jecsand838 opened a new pull request, #6965: URL: https://github.com/apache/arrow-rs/pull/6965
# Which issue does this PR close? Part of https://github.com/apache/arrow-rs/issues/4886 # Rationale for this change The primary objective of this PR is to enhance the arrow-rs Avro implementation by introducing full support for Avro data types, support for Avro aliases, and laying the foundations for an Avro writer. These enhancements are crucial for several reasons: **1. Enhanced Data Interoperability:** By supporting these additional types, the Avro reader becomes more compatible with a wider range of Avro schemas. This ensures that users can ingest and process diverse datasets without encountering type-related limitations. **2. Foundational Support for an Avro Writer:** This PR lays the groundwork for writing Arrow data structures to Avro format by introducing foundational support for an Avro writer. Previously, the focus was primarily on reading and converting Avro data into Arrow's in-memory format. Extending this functionality to include writing ensures bidirectional interoperability between Arrow and Avro. # What changes are included in this PR? ## Avro Codec 1. Support for new types: * Decimals * Maps * Enums * UUID (_in-progress_) 2. Extended namespace support to all supported types 3. Added Alias support (_in-progress_) 4. Added Arrow Schema -> Avro Schema mapping logic 5. Extended support for local timestamps 6. Added Unit tests ## Avro Record Decoder 1. Support for new types: * Lists * Fixed * Interval * Decimal * Map * Enum * UUID (_in-progress_) 2. Expanded nullability support 3. Added Unit tests ## Avro Writer Foundations 1. Setup basic initial foundation for writer: * mod file * VLQ Encoder 2. Added initial support for Arrow -> Avro JSON Schema builder 3. Added Unit tests # Are there any user-facing changes? No, none of these types are public yet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
