Re: [Python] Is there a way to specify a column as non-nullable with parquet.write_table?

Yes, but you will need to resolve https://issues.apache.org/jira/browse/ARROW-5169 write_table should respect the field-level nullability in the schema of the Table you pass On Thu, May 23, 2019 at 10:34 AM Tim Swast wrote: > > I'm currently using parquet as the intermediate format when

[Python] Is there a way to specify a column as non-nullable with parquet.write_table?

I'm currently using parquet as the intermediate format when uploading a pandas DataFrame to Google BigQuery. We encounter a problem when trying to append a parquet file to a table with required fields (issue: https://github.com/googleapis/google-cloud-python/issues/8093). Is there a way to mark