zeroshade commented on PR #2494: URL: https://github.com/apache/arrow-adbc/pull/2494#issuecomment-2659625447
> I'm wondering why we have all these copy into operations with no rows loaded and if there happens to be 5 of these in a row will it abort prematurely??? It's the `finishCopy` part. Once all the uploading has completed, there's a loop calling `executeCopy` if not all of the files have been loaded yet. It makes 5 attempts at performing the last copies and then aborts if there are still files that weren't copied yet. But with the latest changes, it should be waiting until the existing ones complete before moving on to the final attempts so I don't know how you're getting the abort in this scenario. I can't see any way in the code that it should be able to end up in the retry loop until the other COPY INTO commands finish... can you give me any more information about the shape of your data? How many rows/columns? I want to try to see if I can reproduce the failure you're seeing somehow so I can try to debug how it's happening. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
