Ok turns out this might actually be easier to do in C (well for me at least), doing a man wget shows I can just pipe the output to standard out, and use that to feed a parsing program.
On 4/14/07, Steve <[EMAIL PROTECTED]> wrote:
> This is so simple, if it were me, I might do it in shell script using > 'wget' (or 'curl') and the 'date' command to do the date wrangling. > > -=Fozz > > -- > [EMAIL PROTECTED] is Doran L. Barton, president/CTO, Iodynamics LLC > Iodynamics: IT and Web services by Linux/Open Source specialists > "Dealers will hear car talk at noon" > -- Headline seen in newspaper Thats what I tried in my first iteration, but my bash-scripting fu sucks, so what I've done thus far is wrote a C program that takes the date range as input (or if none is given, just uses the current date), then constructs the proper URL and uses wget to obtain the files. However, at present the program just creates a local mirror of the file. My next step would be to open the files and parse the data line by line looking for what I need, but this seems a bit wasteful given the string parsing capabilities of scripting languages such as python, perl and PHP.
/* PLUG: http://plug.org, #utah on irc.freenode.net Unsubscribe: http://plug.org/mailman/options/plug Don't fear the penguin. */
