iSparshP commented on issue #30429: URL: https://github.com/apache/arrow/issues/30429#issuecomment-5414831071
I'd like to work on this. Reading the earlier discussion, the open question was mostly around semantics, so let me pin down a concrete scope before coding: - Add an `append` (bool) option to the C++ CSV `WriteOptions` (default `false` = overwrite/create, matching `readr::write_csv()`), plumbed through the CSV `MakeCSVWriter` / file-writing path. - When `append=true` and the target exists, open the sink in append mode and **skip the header row** so the appended data doesn't re-emit column names; when the file doesn't exist, create it and write the header as usual. - Keep it to the C++ writer surface for this issue; the R/Python binding wiring can follow separately. Two things I'd like a maintainer's steer on: 1. Whether `append` belongs on `WriteOptions` vs. being driven purely by the output-stream open mode the caller passes in. 2. Header behavior on append to an existing file — skip header (my assumption above) vs. leave it to the caller. Happy to adjust to whatever the current preference is. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
