Mandukhai-Alimaa commented on issue #3625: URL: https://github.com/apache/arrow-adbc/issues/3625#issuecomment-3478695269
Hi @davelee1972, I tested this using the Python driver manager with adbc_stmt_kwargs applied, and the concurrency setting appears to be working correctly. What I’m seeing: - With default concurrency (the default is 4), multiple COPY operations start concurrently, as expected. <img width="1408" height="392" alt="Image" src="https://github.com/user-attachments/assets/39a6929f-f63d-4a5a-8825-bf1747334b7b"; /> - When I explicitly set "adbc.snowflake.statement.ingest_copy_concurrency": "1", the COPY operations run sequentially and wait for the previous one to finish. There’s no overlap in start/end timestamps. <img width="1394" height="206" alt="Image" src="https://github.com/user-attachments/assets/9340c118-2088-4f06-a301-b976b0be3b3d"; /> here is the snippet I used to control the concurrency. ``` cursor_kwargs = { "adbc_stmt_kwargs": { "adbc.snowflake.statement.ingest_copy_concurrency": concurrency, } } with connection.cursor(**cursor_kwargs) as cursor: ``` If you can provide further clarification, happy to investigate more. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
