RE: Downloading s3 uris

2016-02-29 Thread Aaron Carey
[aca...@ilm.com] Sent: 29 February 2016 08:53 To: user@mesos.apache.org Subject: RE: Downloading s3 uris Sorry apparently the inline image didn't work: http://i.imgur.com/x1cPXvW.png From: Aaron Carey [aca...@ilm.com] Sent: 29 February 2016 08:50 To: user

RE: Downloading s3 uris

2016-02-29 Thread Aaron Carey
Sorry apparently the inline image didn't work: http://i.imgur.com/x1cPXvW.png From: Aaron Carey [aca...@ilm.com] Sent: 29 February 2016 08:50 To: user@mesos.apache.org Subject: RE: Downloading s3 uris To illustrate: [X] /var/lib/mesos/slaves/20160212-131720

RE: Downloading s3 uris

2016-02-29 Thread Aaron Carey
3 root root 4.0K Feb 26 18:10 .. From: Aaron Carey [aca...@ilm.com] Sent: 29 February 2016 08:45 To: user@mesos.apache.org Subject: RE: Downloading s3 uris Yeah, I've managed to find the sandbox itself on disk, but it's empty, even though the file shows up

Re: Downloading s3 uris

2016-02-26 Thread Joseph Wu
sing something here? > > Thanks for your help, > > Aaron > > > -- > *From:* Radoslaw Gruchalski [ra...@gruchalski.com] > *Sent:* 26 February 2016 17:41 > > *To:* user@mesos.apache.org; user@mesos.apache.org > *Subject:* Re: Downloadi

RE: Downloading s3 uris

2016-02-26 Thread Aaron Carey
/mesos/sandbox?) Am I missing something here? Thanks for your help, Aaron From: Radoslaw Gruchalski [ra...@gruchalski.com] Sent: 26 February 2016 17:41 To: user@mesos.apache.org; user@mesos.apache.org Subject: Re: Downloading s3 uris Just keep in mind that every

Re: Downloading s3 uris

2016-02-26 Thread Radoslaw Gruchalski
ca...@ilm.com> wrote: I was trying to avoid generating urls for everything as this will complicate things a lot. Is there a straight forward way to get the fetcher to do it directly? From: haosdent [haosd...@gmail.com] Sent: 26 February 2016 16:27 To: user Subject: Re: Downloading s3 uri

RE: Downloading s3 uris

2016-02-26 Thread Aaron Carey
I know this is a stupid question... but how do I just install the client without all the rest of the stuff? From: haosdent [haosd...@gmail.com] Sent: 26 February 2016 16:50 To: user Subject: Re: Downloading s3 uris So far have to install a hdfs client if you

Re: Downloading s3 uris

2016-02-26 Thread Shuai Lin
ent [haosd...@gmail.com] > *Sent:* 26 February 2016 16:27 > *To:* user > *Subject:* Re: Downloading s3 uris > > I think still could pass AWSAccessKeyId if it is private? > http://www.bucketexplorer.com/documentation/amazon-s3--how-to-generate-url-for-amazon-s3-files.html

Re: Downloading s3 uris

2016-02-26 Thread haosdent
Abhishek > > From: Aaron Carey <aca...@ilm.com> > Reply-To: "user@mesos.apache.org" <user@mesos.apache.org> > Date: Friday, 26 February 2016 at 8:31 AM > To: "user@mesos.apache.org" <user@mesos.apache.org> > Subject: RE: Downloading s3 uris &g

Re: Downloading s3 uris

2016-02-26 Thread Abhishek Amralkar
org" <user@mesos.apache.org> Subject: RE: Downloading s3 uris I was trying to avoid generating urls for everything as this will complicate things a lot. Is there a straight forward way to get the fetcher to do it directly? From: haosdent [haosd...@gmail.com] Sent: 26 February 2016 16:2

RE: Downloading s3 uris

2016-02-26 Thread Aaron Carey
Date: Friday, 26 February 2016 at 8:23 AM To: "user@mesos.apache.org<mailto:user@mesos.apache.org>" <user@mesos.apache.org<mailto:user@mesos.apache.org>> Subject: Re: Downloading s3 uris Haven't directly used s3 download, but I think a workaround (if you don't care ACL abou

Re: Downloading s3 uris

2016-02-26 Thread haosdent
ep bucket/files public? > > -Abhishek > > From: Zhitao Li <zhi...@uber.com> > Reply-To: "user@mesos.apache.org" <user@mesos.apache.org> > Date: Friday, 26 February 2016 at 8:23 AM > To: "user@mesos.apache.org" <user@mesos.apache.org> > Subjec

Re: Downloading s3 uris

2016-02-26 Thread Abhishek Amralkar
In that case do we need to keep bucket/files public? -Abhishek From: Zhitao Li <zhi...@uber.com> Reply-To: "user@mesos.apache.org" <user@mesos.apache.org> Date: Friday, 26 February 2016 at 8:23 AM To: "user@mesos.apache.org" <user@mesos.apache.or

Re: Downloading s3 uris

2016-02-26 Thread Zhitao Li
Haven't directly used s3 download, but I think a workaround (if you don't care ACL about the files) is to use http url instead. > On Feb 26, 2016, at 8:17 AM, Aaron Carey wrote:

Downloading s3 uris

2016-02-26 Thread Aaron Carey
I'm attempting to fetch files from s3 uris in mesos, but we're not using hdfs in our cluster... however I believe I need the client installed. Is it possible to just have the client running without a full hdfs setup? I haven't been able to find much information in the docs, could someone point