bascheibler commented on issue #1283: URL: https://github.com/apache/arrow-adbc/issues/1283#issuecomment-1808829283
I've built from master (it installed `adbc_driver_snowflake` version '0.0.0+gff222e20' following the instructions [here](https://github.com/apache/arrow-adbc/tree/main/python/adbc_driver_snowflake#building)) and I'm still getting some errors, as the examples listed below: ``` panic: close of nil channel goroutine 232 [running]: github.com/apache/arrow-adbc/go/adbc/driver/snowflake.newRecordReader.func4() /adbc/go/adbc/driver/snowflake/record_reader.go:572 +0x85 created by github.com/apache/arrow-adbc/go/adbc/driver/snowflake.newRecordReader /adbc/go/adbc/driver/snowflake/record_reader.go:568 +0xbc8 ``` or (with more info printed from `traceback.format_exc()`) ``` Traceback (most recent call last): File "/app/snowflake.py", line 41, in export_table Table = cursor.fetch_arrow_table() ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/arrow-adbc/python/adbc_driver_manager/adbc_driver_manager/dbapi.py", line 1032, in fetch_arrow_table return self._results.fetch_arrow_table() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/arrow-adbc/python/adbc_driver_manager/adbc_driver_manager/dbapi.py", line 1135, in fetch_arrow_table return self._reader.read_all() ^^^^^^^^^^^^^^^^^^^^^^^ File "adbc_driver_manager/_reader.pyx", line 90, in adbc_driver_manager._reader.AdbcRecordBatchReader.read_all File "adbc_driver_manager/_reader.pyx", line 40, in adbc_driver_manager._reader._AdbcErrorHelper.check_error adbc_driver_manager.OperationalError: UNKNOWN: [Snowflake] arrow/ipc: unknown error while reading: cannot allocate memory ``` The tables that failed have 2.2M, 98K and 13.3K rows with 48.0MB, 41.9MB and 229.5KB, respectively. Python packages: - -e git+https://github.com/apache/arrow-adbc.git@ff222e2004e281d26395964d982320bf5c506160#egg=adbc_driver_manager&subdirectory=python/adbc_driver_manager - -e git+https://github.com/apache/arrow-adbc.git@ff222e2004e281d26395964d982320bf5c506160#egg=adbc_driver_snowflake&subdirectory=python/adbc_driver_snowflake - numpy==1.26.1 - pyarrow==14.0.1 - python-dotenv==1.0.0 - setuptools==68.2.2 - wheel==0.41.3 Please let me know if there's anything else I could do to help debugging this. I'd be happy to contribute. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
