Re: Problem reading from S3 in standalone application

2014-08-06 Thread Nicholas Chammas
See here: https://wiki.apache.org/hadoop/AmazonS3 s3:// refers to a block storage system and is deprecated . Use s3n:// for "regular" files you can see in the S3 web console. Nick On Wed, Aug 6, 2014

Re: Problem reading from S3 in standalone application

2014-08-06 Thread sparkuser2345
Evan R. Sparks wrote > Try s3n:// Thanks, that works! In REPL, I can succesfully load the data using both s3:// and s3n://, why the difference? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Problem-reading-from-S3-in-standalone-application-tp11524p11537.

Re: Problem reading from S3 in standalone application

2014-08-06 Thread Evan Sparks
Try s3n:// > On Aug 6, 2014, at 12:22 AM, sparkuser2345 wrote: > > I'm getting the same "Input path does not exist" error also after setting the > AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables and using > the format "s3:///test_data.txt" for the input file. > > > > -- >

Re: Problem reading from S3 in standalone application

2014-08-06 Thread sparkuser2345
I'm getting the same "Input path does not exist" error also after setting the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables and using the format "s3:///test_data.txt" for the input file. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/P