Thanks Eric. I am going to have to redemux a bunch of data since our custom processor has changed a bit and we parse data and store into the fields map for pig to read easily.
I think I can do this simply by copying from /chukwa/finalArchives/20100309 then renaming to .done. Once I do that does the data I reprocess overwrite the existing data in /chukwa/repos or do I need to remove that data as well? Once it's completed does it put the data into the finalArchives/20100309 dir or put into finalArchives/[TODAY'S DATE]? So if I ever needed to reprocess again I'd loose the ability to reprocess by date? On Mar 12, 2010, at 2:07 PM, Eric Yang wrote: > It's for debug. You should be able to reprocess original data by copying > archive for that time range back to sink directory and rename to .done file. > > Regards, > Eric > > On 3/12/10 12:05 PM, "Corbin Hoenes" <cor...@tynt.com> wrote: > >> Is there are way to rerun the data stored InError through the demux process >> again? Or is that bucket more for debugging and investigation? >> >
