virajjasani commented on PR #6543: URL: https://github.com/apache/hadoop/pull/6543#issuecomment-2046222247
> I'm wondering if we should provide a list of options to "optimise", e.g "create, mkdir, delete" and the specific optimisations those get turned on. Yes, it is suspiciously like those option sets we have for databases. I believe this would be good optimization tuning overall, and yes it does remind of database optimizations. In fact, HBase can use these optimizations for HFile creation, deletion etc too (as long as it knowns when and what it is doing). Since we already have `fs.s3a.create.performance`, how about we file separate jiras for `fs.s3a.delete.performance` etc new modes? or you meant, we provide a generic config `fs.s3a.optimizations` with values including `create` and/or `delete`, accordingly we skip HEAD requests? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
