triplesheep commented on issue #25556: [SPARK-28853][SQL] Support conf to organize file partitions by file path URL: https://github.com/apache/spark/pull/25556#issuecomment-524289597 > Hm, I'm uneasy that this may introduce behavior and performance changes, but I don't have a specific problem already in mind. Why would name necessarily be more meaningful? Yeah, it exactly may introduce behavior and performance changes so I set it to be a SQLConf with default value false. The file path is meaning here because it represents the partitions of data, for example /base_path/day=1/file1, /base_path/day=2/file2 from the path we can know file1 and file2 are located in different partitions.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
