Hi Johannes, HDFS block size is controlled by the property 'dfs.blocksize'. You should be able to use `set` to control this within your pig script: http://pig.apache.org/docs/r0.10.0/cmds.html#set I think that it should also work to pass that in via PIG_OPTS, e.g. PIG_OPTS='-Ddfs.blocksize=1048576'
HTH, Joe On Mon, Oct 15, 2012 at 6:04 AM, Johannes Schwenk < [email protected]> wrote: > Hi, > > I would like to set the HDFS block size of my pig scripts output files. > How do I do that? I tried to use > > PIG_OPTS="-Dpig.path.block.size=1048576"; > > which seemed to me the only appropriate option I could find. > > Thanks for any hints! > Johannes Schwenk > > -- > Softwareentwickler (Reporting) > ________________________________________________________ > > ADITION technologies AG > Schwarzwaldstraße 78b > 79117 Freiburg > > http://www.adition.com > > T +49 / (0)761 / 88147 - 30 > F +49 / (0)761 / 88147 - 77 > SUPPORT +49 / (0)1805 - ADITION > > (Festnetzpreis 14 ct/min; Mobilfunkpreise maximal 42 ct/min) > > Eingetragen beim Amtsgericht Düsseldorf unter HRB 54076 > Vorstände: Andreas Kleiser, Jörg Klekamp, Tihomir Perkovic, Marcus Schlüter > Aufsichtsratsvorsitzender: Rechtsanwalt Daniel Raimer > UStIDNr.: DE 218 858 434 > >
