pkit commented on issue #2084: URL: https://github.com/apache/arrow-adbc/issues/2084#issuecomment-2297750457
`cursor.adbc_ingest` has additional role requirements: `CREATE STAGE` More than that, it can be pretty sub-optimal if I do a lot of asynchronous inserts before commit. Unless I don't understand how it works underneath. Obviously I would prefer not to manage my own serialization, or to keep all the `RecordBatch`es in memory. Essentially my use case is akin to classic ETL: stream in batches of data (SELECT), transform, stream back (INSERT) while keeping it all under strict memory requirements (for example 4x16MB batches max at the same time). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
