Hi,

What I would like to do is to store outputs to different directories based
on record value. Essentially I want to read the date from a field and store
the output in yyyy/mm/dd directory structure. How should I go about this? I
want to use AvroStorage for storing the stuff. I want to specify STORE xyz
INTO '$location' USING MyStorage(); where $location would be the base
output directory. MyStorage() would be the modified version of AvroStorage
which stores the values in $location/yyyy/mm/dd/part-abc files, reading the
yyyymmdd from a particular field in the input records.

What is the way to achieve this with minimal changes?

Nick

Reply via email to