jihoonson commented on issue #3435: Consider including hadoop-aws in the lib folder URL: https://github.com/apache/incubator-druid/issues/3435#issuecomment-559194864 > I think it'd also be good to include `hadoop-aws` by default to improve the user experience — especially since [the documentation for hadoop ingestion has examples that have paths in S3](https://druid.apache.org/docs/latest/ingestion/hadoop.html#inputspec). Particularly for the hadoop doc linked, I think the doc is wrong. The example should use `hdfs` instead of `s3n`. I don't see much benefit for including `hadoop-aws` in `lib`. Isn't it enough if we add a doc saying "you need hadoop-aws.jar in your classpath and here is how you can get it using the `pull-deps` tool"? We currently have no hadoop-related jars under `lib`. All of them are under `hadoop-dependencies` or `extensions/druid-hdfs-storage`. I guess it could be another option to include `hadoop-aws` in `druid-hdfs-storage`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
