I want to use s3a: urls in fetcher. I’m using dcos 1.7 which has hadoop 2.5 on its agents. This version has the necessary hadoop-aws and aws-sdk:
hadoop--afadb46fe64d0ee7ce23dbe769e44bfb0767a8b9]$ ls usr/share/hadoop/tools/lib/ | grep aws aws-java-sdk-1.7.4.jar hadoop-aws-2.5.0-cdh5.3.3.jar What config/scripts do I need to hack to get these guys on the classpath so that "hadoop fs -copyToLocal” works? Thanks, Jamie
