pacman82 opened a new issue, #6591:
URL: https://github.com/apache/arrow-rs/issues/6591

   **Describe the bug**
   <!--
   A clear and concise description of what the bug is.
   -->
   i16 counting row groups overflows and becomes negative causing panic
   
   **To Reproduce**
   <!--
   Steps to reproduce the behavior:
   -->
   Writing 32769 row groups with the file writer
   
   **Expected behavior**
   <!--
   A clear and concise description of what you expected to happen.
   -->
   Maybe an error indicating that too many batches have been written would be 
preferable. Alternatively it would be nice if this just worked, yet I could 
also get behind the thinking that this may be too many row groups for a single 
file anyway.
   
   **Additional context**
   <!--
   Add any other context about the problem here.
   -->
   Occurred in the context of a user running `odbc2parquet`. His row groups 
were very small (15 rows) due to an issue with his row sizes, causing him to 
write lots of row groups into a single file. See: 
<https://github.com/pacman82/odbc2parquet/issues/652>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to