truffle-dev commented on issue #887: URL: https://github.com/apache/arrow-go/issues/887#issuecomment-4878840743
Scope note from the #883 approval: one V2-side follow-up belongs here alongside the V1/OffsetIndex fix. An oversized single row can grow an aligned batch past the 1 GB `maxSafeBatchDataSize` cap. A row can't span a V2 page, so this is inherent to the row-alignment path rather than a spaced-write regression. Today the late `FlushCurrentPage` `MaxInt32` guard is the only backstop; an explicit error at the point the aligned batch exceeds the cap would fail loudly instead of leaning on the downstream guard. It's small and shares the `doBatches` alignment code this issue already reroutes, so it fits here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
