Re: How to track files processed

2016-04-18 Thread Sayth Renshaw
Thank you Martin and Peter To clarify Peter at the moment only writing to csv but am wanting to set up an item pipeline to SQL db next. I will have a go at your examples Martin and see how i go. Thank you both for taking time to help. Sayth --

Re: How to track files processed

2016-04-18 Thread Martin A. Brown
Greetings, >If you are parsing files in a directory what is the best way to >record which files were actioned? > >So that if i re-parse the directory i only parse the new files in >the directory? How will you know that the files are new? If a file has exactly the same content as another

Re: How to track files processed

2016-04-18 Thread Peter Otten
Sayth Renshaw wrote: > If you are parsing files in a directory what is the best way to record > which files were actioned? What do you do with the result of the parsing process? If you write it to another file you can just look if that file already exists. If you write it to a database there

How to track files processed

2016-04-18 Thread Sayth Renshaw
Hi If you are parsing files in a directory what is the best way to record which files were actioned? So that if i re-parse the directory i only parse the new files in the directory? Thanks Sayth -- https://mail.python.org/mailman/listinfo/python-list