hi! i'm coding a tool in perl wich aquires financial statements from ftp://ftp.sec.gov/edgar/data/817979/ (example) and parses it to a DB. i tried a bunch of cpan modules but all of them haunted me in my dreams..
so i came to the conglusion, that the only way to save my day is to use a well developed standalone console-ftp-client. (since i don't want to write my own ftp-module... if the people on cpan can't handle that properly, i won't have a chance ;-) as you might have already guessed, lftp was my choice. my problem: i use the mirror function of lftp to get the whole directory for every CIK (--> 817979) for compatibility reasons, most of the files in /edgar/data/817979/* are linked to according files in subdirectories.. as i am downloading millions of files from thousand of CIKS i don't want that symlinks on my HDD for several reasons. (parsing issues, real shocking look-at in 'ls') using -L in mirror is an even worse idea. i thought of writing a shellscript that removes all symlinks in all those dirs every day.. but i don't like the idea. i studied the manpage and found 'glob' ... but symlinks are recognized as plain files... now my question: is there any way to let lftp ignore symlinks? if not, will such a feature be implemented? Gerulf Schnitzler
