zeroshade commented on issue #374: URL: https://github.com/apache/arrow-go/issues/374#issuecomment-2867904854
Looks like, as far as I can tell, duckdb is just pulling that value from the row group metadata which could be the compressed or uncompressed size (depending on which metadata value it's choosing to read). A better question, if the output file itself is only 351MB, how could the row group size be 1GB unless it's referring to the uncompressed size rather than the compressed size. Meanwhile `RowGroupTotalBytesWritten()` returns the raw number of bytes written to the file itself, which would be the compressed sizes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
