hungcs opened a new issue, #14025:
URL: https://github.com/apache/arrow/issues/14025
For example, I know that one particular column will always be a list of
floats, so I do:
```
schema = {"col1": pa.int64()}
df.to_parquet(schema=schema)
```
however, it seems providing an explicit schema will make it so that all
other columns are not included in the resulting parquet file, I would like to
have it so that all the other column types are inferred.
I know there is a `pyarrow.from_pandas()`, but the df may be a dask dataframe
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
