zmrdltl commented on issue #5410: URL: https://github.com/apache/arrow-rs/issues/5410#issuecomment-1961170053
> You should be able to use ColumnWriterImpl for this purpose? This is generic on the column data type? > > https://docs.rs/parquet/latest/parquet/column/writer/type.ColumnWriterImpl.html To successfully write GlueSQL data types into Parquet files, it becomes necessary to explicitly implement the logic for mapping between the data types of GlueSQL and those supported by Parquet. This process involves creating an instance of ColumnWriterImpl for each specific data type you intend to write. Furthermore, you are required to invoke the write method that is appropriate for the data type in question. For instance, writing a DataType::Int from GlueSQL as an INT32 type in Parquet necessitates the use of Int32ColumnWriter. This approach ensures that each GlueSQL data type is accurately mapped and written using the correct Parquet data type, thereby maintaining data integrity and consistency across different storage formats. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
