lidavidm commented on issue #1523: URL: https://github.com/apache/arrow-adbc/issues/1523#issuecomment-1932363885
Hmm, the problem is that the PyArrow bindings are intentionally restrictive about how you can extend them, while we want to be able to pass on ADBC errors through this interface, so we have a wrapper...I suppose the wrapper needs to try harder to pretend to be a real reader. Right now, the DBAPI portion always wraps the stream in a RecordBatchReader. I think what I might try doing instead is have it use the low-level methods directly bypassing PyArrow, and if you instead request the reader, we just give you a plain PyArrow RecordBatchReader (which will _not_ give you rich error metadata because we can't extend this interface in Python). Or I will see if we can finagle it so that we can link to PyArrow in Cython (however, this will mean we're dependent on particular PyArrow versions which I would very much like to avoid). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
