The GitHub Actions job "pre-commit" on iceberg-cpp.git/avro_reader has failed.
Run started by GitHub user shangxinli (triggered by shangxinli).

Head commit for run:
3db1f633938299e251c79d623867e225cf25c643 / Xinli Shang <[email protected]>
feat: eliminate GenericDatum in Avro reader for performance

Replace GenericDatum intermediate layer with direct Avro decoder access
to improve manifest I/O performance.

Changes:
- Add avro_direct_decoder_internal.h with DecodeAvroToBuilder API
- Add avro_direct_decoder.cc implementing direct Avro→Arrow decoding
  - Primitive types: bool, int, long, float, double, string, binary, fixed
  - Temporal types: date, time, timestamp
  - Logical types: uuid, decimal
  - Nested types: struct, list, map
  - Union type handling for nullable fields
- Modify avro_reader.cc to use DataFileReaderBase with direct decoder
  - Replace DataFileReader<GenericDatum> with DataFileReaderBase
  - Use decoder.decodeInt(), decodeLong(), etc. directly
  - Remove GenericDatum allocation and extraction overhead
- Update CMakeLists.txt to include new decoder source

Performance improvement:
- Before: Avro binary → GenericDatum → Extract → Arrow (3 steps)
- After: Avro binary → decoder.decodeInt() → Arrow (2 steps)

This matches Java implementation which uses Decoder directly via
ValueReader interface, avoiding intermediate object allocation.

All avro_test cases pass.

Issue: #332

Report URL: https://github.com/apache/iceberg-cpp/actions/runs/19803838997

With regards,
GitHub Actions via GitBox

Reply via email to