Zan-L commented on issue #2128: URL: https://github.com/apache/arrow-adbc/issues/2128#issuecomment-2477157110
@joellubi I can confirm that ADBC Snowflake 1.0.0 does not have this issue. And based on the fact that this problem persists after upgrading Snowflake Go Driver and ADBC Snowflake 1.0.0 works well, I tend to believe the root cause comes from ADBC. But like @davlee1972, older ADBC versions have other issues like OOM or those caused by older arrow build, so downgrade is really not an option. Another observation to help you debug: There is randomness in this issue - Different retries result in different number of files remaining, and could eventually succeed for the same dataset if we retry enough times. I would appreciate if you could raise the priority and find a fix soon. Currently, since ADBC Snowflake does not support ingestion with temp tables, this ingestion instability risks corruption of target Snowflake tables when it happens, which renders it non-adaptable for production ETL pipelines. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
