I am able to set it via the API. Configuration.setBoolean(mapred.output.compress,true). This works!
But the -D from the command line still doesn't work. Any idea what I may be missing here? Some additional info - Also when I try running the -D on command line on a local cluster (pseudo distributed mode) it works, but when I try it on a fully distributed cluster running jobs from a client machine it doesn't work. Is there a different way for setting it in this case - in hadoop-env perhaps? Thanks Sid On Wed, Jun 6, 2012 at 4:06 PM, Sid Kumar <sqlsid...@gmail.com> wrote: > Mayank, > I dont have a final tag for that property set. I looked at the > mapred-default.xml in the src/mapred folder and that doesn't have a final > tag too. Should I set it explicitly to false? > > Sid > > > On Wed, Jun 6, 2012 at 3:50 PM, Mayank Bansal <may...@apache.org> wrote: > >> Check your mapred site xml if these parameters have <final>true</final> >> >> making final to false should solve your problem. >> >> >> On Wed, Jun 6, 2012 at 3:41 PM, Sid Kumar <sqlsid...@gmail.com> wrote: >> >>> Hi, >>> I am trying to override mapred-site.xml (more specifically >>> mapred.compress.map.output >>> and mapred.output.compression. >>> codec) from the command line when I >>> execute the jar. >>> I have been using hadoop jar <jarname> <class> - >>> Dmapred.compress.map.output=true and >>> -Dmapred.output.compression.codec=org.apache.hadoop.io.SnappyCodec >>> >>> The above doesnt work as the job.xml for the jar still uses the default >>> properties and not the one i specify here. Is there a different approach to >>> override these properties. I am submitting jobs from a client machine that >>> has the same version of configuration files as my cluster. >>> >>> Thanks >>> >>> Sid >>> >> >> >
