jackylee-ch opened a new pull request, #10192:
URL: https://github.com/apache/paimon/pull/10192
## Purpose
`HdfsNativeFileIO` is the default backend for `hdfs://` and `viewfs://` and
implements `write_parquet/orc/avro/blob/lance/mosaic/vortex`, but not
`write_row`. So it inherited `FileIO.write_row`, which raises
`NotImplementedError`, and any `FILE_FORMAT_ROW` write on native HDFS
(row-format tables, data-evolution sidecar files) crashed.
## Change
- Add `write_row`, mirroring `PyarrowFileIO.write_row`: derive the Paimon
fields from the Arrow schema when not given, write through the existing
`new_output_stream` with `FormatRowWriter`, and `delete_quietly` + re-raise
on failure. No new dependency; uses the same adapters as `write_blob`.
## Tests
- Round-trip a table through `write_row` (pointing `new_output_stream` at the
local FS) and read it back with `FormatRowReader`. Verified non-vacuous
(without the override `write_row` raises the inherited
`NotImplementedError`).
Written with Claude Code; verification is mine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
