zeroshade commented on issue #622: URL: https://github.com/apache/arrow-go/issues/622#issuecomment-3815029557
> I am not entirely sure I understand the specific point you are raising. My knowledge of Apache Arrow isn't deeply specialized, but I can describe my use case for more context. Could you share any minimum amount of code and synthetic data so that I could attempt to trigger the error myself locally? > During this process, I’ve noticed that if a message is very large (tens or hundreds of MBs)—which I assume means a specific field value is extremely long—writing multiple rows into a single Parquet file triggers this panic. Are you able to share one of these messages? > Other types outside this range -> json.Marshal -> largeString Perhaps use variant? Your use case seems normal and nothing out of the ordinary, so I'm surprised you're hitting this issue. I'd like to try to recreate the error myself so I can try to debug it. If you could share sample code and data that would be very helpful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
