renzepost commented on issue #26248:
URL: https://github.com/apache/airflow/issues/26248#issuecomment-1889207076
Hi,
I'm running into this very same issue. I'm using `MySQLToGCSOperator` with
`export_format="parquet"`.
```
Traceback (most recent call last):
File
"/opt/python3.8/lib/python3.8/site-packages/airflow/providers/google/cloud/transfers/sql_to_gcs.py",
line 181, in execute
for file_to_upload in self._write_local_data_files(cursor):
File
"/opt/python3.8/lib/python3.8/site-packages/airflow/providers/google/cloud/transfers/sql_to_gcs.py",
line 304, in _write_local_data_files
self._write_rows_to_parquet(parquet_writer, rows_buffer)
File
"/opt/python3.8/lib/python3.8/site-packages/airflow/providers/google/cloud/transfers/sql_to_gcs.py",
line 227, in _write_rows_to_parquet
tbl = pa.Table.from_pydict(rows_pydic, parquet_writer.schema)
File "pyarrow/table.pxi", line 3725, in pyarrow.lib.Table.from_pydict
File "pyarrow/table.pxi", line 5271, in pyarrow.lib._from_pydict
File "pyarrow/array.pxi", line 350, in pyarrow.lib.asarray
File "pyarrow/array.pxi", line 320, in pyarrow.lib.array
File "pyarrow/array.pxi", line 39, in pyarrow.lib._sequence_to_array
File "pyarrow/error.pxi", line 144, in
pyarrow.lib.pyarrow_internal_check_status
File "pyarrow/error.pxi", line 123, in pyarrow.lib.check_status
pyarrow.lib.ArrowTypeError: object of type <class 'str'> cannot be converted
to int
```
I'm on Cloud Composer 2.4.6, Airflow 2.6.3. I think as a workaround, I might
either try exporting to CSV instead, or exporting the timestamp fields as Unix
time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
