valkum commented on issue #17446: URL: https://github.com/apache/datafusion/issues/17446#issuecomment-3262124560
Yes. We have a one to many relationship of some data and it doesn't make sense to store this normalized in a different file. My understanding of the parquet format, or rather dremel encoding, is that this should work rather good. This is an intermediate step on our way to rework and modernize our data pipelines. So in the end this might not even be used very long, but we have this intermediate input file right now, and I thought it would be a good test to see if datafusion is fit for our task. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
