theelderbeever commented on issue #7686: URL: https://github.com/apache/arrow-datafusion/issues/7686#issuecomment-1741538080
I wouldn't go as far as saying that it can't handle them because we are actually using them with partitions to solid success right now. Could logic be added to "hydrate" the partition column after the file read? I need to dig further in to understand what that even means however, since you know about the qualifying files during the scan you could maybe parse the file path to generate the column on the fly and add it post reading parsing the files? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
