[
https://issues.apache.org/jira/browse/HADOOP-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096945#comment-15096945
]
Matthew Paduano commented on HADOOP-12548:
------------------------------------------
OK. I played with this a little. This is the command that worked for me, with
and *without* the space.
But the -D flag *had to immediately follow "distcp"*. That was the trick...
hadoop distcp
*-Dhadoop.security.credential.provider.path=jceks://hdfs@localhost:9000/user/mattp/aws.jceks*
-libjars
/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/jackson-core-2.2.3.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/jackson-annotations-2.2.3.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/jackson-databind-2.2.3.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/hadoop-aws-3.0.0-SNAPSHOT.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/aws-java-sdk-core-1.10.6.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/aws-java-sdk-kms-1.10.6.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/aws-java-sdk-s3-1.10.6.jar,/home/mattp/hadoop/hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/tools/lib/joda-time-2.8.1.jar
hdfs://localhost:9000/user/mattp/testmore s3a://test-s3-out/
> read s3 creds from a Credential Provider
> ----------------------------------------
>
> Key: HADOOP-12548
> URL: https://issues.apache.org/jira/browse/HADOOP-12548
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Allen Wittenauer
> Assignee: Larry McCay
> Attachments: CredentialProviderAPIforS3FS-002.pdf,
> HADOOP-12548-01.patch, HADOOP-12548-02.patch, HADOOP-12548-03.patch,
> HADOOP-12548-04.patch
>
>
> It would be good if we could read s3 creds from a source other than via a
> java property/Hadoop configuration option
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
