You should be able to do it using some bash trickery. %declare inputs `hls | cut -d '/' -f 2- | sort | tail -n $num | sed 's/^/\//' | sed 's/$/,/' `
Where $num is the number of files you want. Then you can use $inputs in your LOAD statement. I haven't tried this, so it might (will) contain bugs. -- Gianmarco De Francisci Morales On Fri, Jul 1, 2011 at 07:06, Mark <[email protected]> wrote: > We have our data in folders partitioned by day: > > ie /user/pig/logs/2011/06/30 > > Is there any way to select the last x amount of days to use as input? > > Thanks >
