I have recently added a new field to the parsing logic. Instead of fetching
all the pages again, I just want to parse all the pages again with the new
parsing code.

I tried two approaches to achieve the same

1. Merge all the segments and then run the parse command. The merge command
fails with some Out Of Disk Space error.
2. Loop through all the segments and call parse for each segment.  We have
a lot of segments and its taking considerable amount of time.

I am curious to know how others achieve the same. What is the strategy you
follow when you add new fields?

Thanks
Srini

Reply via email to