thisisnic commented on issue #36325: URL: https://github.com/apache/arrow/issues/36325#issuecomment-1609738413
Thanks for reporting this @tdhock . Unfortunately, it's not possible to limit the number of lines to read, due to how the C++ CSV reader has been implemented; more information can be seen in the discussion on #26399. If you tell us more about the context in which you're needing to do this, we may be able to suggest a good workaround though? Just to check, where are you reading the `read_csv_arrow()` docs? When I read them on the pkgdown site, they link to the `?CsvReadOptions` man page, which outlines these in more details, but I'm wondering if this link might not be present in a different presentation of the docs? I'd be hesitant to add them all into that man page as we've intentionally designed `read_csv_arrow()` to translate from the `readr::read_csv()` options we support to the matching Arrow C++ options, and thus mentioning all of the Arrow C++ options in one page might be a bit too much info at once. If you can think of a better way of exposing the relevant options (there probably is one), I'd be happy to review a PR if you'd like to make one? (If you do, let's attach it to a different issue though, as this is slightly different to the original one here). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
