Dirt-Nasty commented on issue #744: URL: https://github.com/apache/arrow-go/issues/744#issuecomment-4184393139
@zeroshade in the simplest terms the array of structs ends up on the wrong row after the parquet is copied into snowflake. After alot of debugging running it through pyarrow made the array struct placement show on the correct row. When analyzing the parquet generated from the Go library in something like duckdb the data appears on the correct row, its not like that prior to ingestion. Its just some small difference in storage that when unpacked Snowflake likes the pyarrow version better than the go version. I can share privately a parquet generated by the go library and then the same one repacked with pyarrow if that helps. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
