Re: Downloading s3 uris

Fri, 26 Feb 2016 08:40:25 -0800

Agreed with @aaron, it will be too much manual work to generate S3 url everytime.

Thanks
Abhishek

From: Aaron Carey <[email protected]>
Reply-To: "[email protected]" <[email protected]>
Date: Friday, 26 February 2016 at 8:31 AM
To: "[email protected]" <[email protected]>
Subject: RE: Downloading s3 uris

I was trying to avoid generating urls for everything as this will complicate things a lot.

Is there a straight forward way to get the fetcher to do it directly?

From: haosdent [[email protected]]
Sent: 26 February 2016 16:27
To: user
Subject: Re: Downloading s3 uris


On Sat, Feb 27, 2016 at 12:25 AM, Abhishek Amralkar <[email protected]> wrote:
In that case do we need to keep bucket/files public?

-Abhishek

From: Zhitao Li <[email protected]>
Reply-To: "[email protected]" <[email protected]>
Date: Friday, 26 February 2016 at 8:23 AM
To: "[email protected]" <[email protected]>
Subject: Re: Downloading s3 uris

Haven't directly used s3 download, but I think a workaround (if you don't care ACL about the files) is to use http url instead.
On Feb 26, 2016, at 8:17 AM, Aaron Carey <[email protected]> wrote:

I'm attempting to fetch files from s3 uris in mesos, but we're not using hdfs in our cluster... however I believe I need the client installed.

Is it possible to just have the client running without a full hdfs setup?

I haven't been able to find much information in the docs, could someone point me in the right direction?

Thanks!

Aaron




--
Best Regards,
Haosdent Huang

Reply via email to