Re: Which OutputCommitter to use for S3?

; >> >>> >> By setting --hadoop-major-version=2 when using the ec2 scripts, >>> >> everything worked fine. >>> >> >>> >> Darin. >>> >> >>> >> >>> >> - Original Message - >>>

Re: Which OutputCommitter to use for S3?

> >> Just to close the loop in case anyone runs into the same problem I had. >> >> >> >> By setting --hadoop-major-version=2 when using the ec2 scripts, >> >> everything worked fine. >> >> >> >> Darin. >> >> >>

Re: Which OutputCommitter to use for S3?

one runs into the same problem I had. > >> > >> By setting --hadoop-major-version=2 when using the ec2 scripts, > >> everything worked fine. > >> > >> Darin. > >> > >> > >> - Original Message - > >> From: Darin McBeath &

Re: Which OutputCommitter to use for S3?

gt;> >at >> >> >org.apache.spark.rdd.PairRDDFunctions.saveAsHadoopFile(PairRDDFunctions.sc >> >ala:940) >> >at >> >> >org.apache.spark.rdd.PairRDDFunctions.saveAsHadoopFile(PairRDDFunctions.sc >> >ala:902) >> >at >> >> >org.apache.spark.a