bascheibler commented on issue #1283:
URL: https://github.com/apache/arrow-adbc/issues/1283#issuecomment-1806322407
I've just experienced the same issue (exception `UNKNOWN: [Snowflake]
arrow/ipc: unknown error while reading: cannot allocate memory`).
I'm running the code snippet below in a Docker container based on the
python:3.12 image. The packages versions are:
- pyarrow==14.0.1
- adbc_driver_snowflake==0.8.0
Here's the code snippet (not the full function's code):
```
def export_table(schema_name, table_name):
query = f"select * from {schema_name}.{table_name}"
with adbc_driver_snowflake.dbapi.connect(
uri = snowflake_uri,
db_kwargs = {"adbc.snowflake.sql.client_option.use_high_precision":
"false"}
) as conn:
with conn.cursor() as cursor:
print(f"Querying {schema_name}.{table_name}")
cursor.execute(query)
try:
Table = cursor.fetch_arrow_table()
except Exception as e:
print(f"{schema_name}.{table_name} got exception {e}")
```
The function above fails after fetching a few tables. I've tried wrapping it
in a for loop and also in a multiprocess Pool. Both don't succeed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
