jorisvandenbossche commented on issue #41857: URL: https://github.com/apache/arrow/issues/41857#issuecomment-2160646152
@bjfar thanks for the report! This is a bit bizarre .. So when pandas' `to_parquet` gets called for the first time, pandas will call `pyarrow.register_extension_type(..)` to register its extension types. This is defined in a python submodule in pandas, so I would expect that normal python execution will ensure this code from importing the submodule is only run once. But maybe that assumption is not true in all cases, or the pytest fixture meddle with the import mechanism? In any case, if we should protect this from happening, that's something that needs to be done on the pandas side. Would you want to report it there? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
