Re: how to search multiple textfiles ? (Python is slow ?)
In message [EMAIL PROTECTED], Stef Mientki wrote: Lawrence D'Oliveiro wrote: In message [EMAIL PROTECTED], Stef Mientki wrote: I'm really amazed by the speed of Python !! It can only be beaten by findstr, which is only available on windows. Did you try find -exec grep -F? well my windows version doesn't understand that : I assumed when you said It can only be beaten by findstr, which is only available on windows, that meant you had tried some non-Windows options, before concluding that Windows findstr was the fastest. -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ? (Python is slow ?)
In message [EMAIL PROTECTED], Stef Mientki wrote: - Pyscripter 110 sec ( PyScripter is the default IDE I use now) - Delphi 20 .. 35 sec - Findstr 4 sec What order did you try try them in? Did you try each one more than once, in different orders? Just to rule out filesystem caching effects. I'm really amazed by the speed of Python !! It can only be beaten by findstr, which is only available on windows. Did you try find -exec grep -F? -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
In message
[EMAIL PROTECTED], George
Sakkis wrote:
$ find -name *py | xargs egrep \bword\b
Better:
find -name '*.py' -exec grep -E \bword\b {} \;
--
http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ? (Python is slow ?)
Lawrence D'Oliveiro wrote: In message [EMAIL PROTECTED], Stef Mientki wrote: - Pyscripter 110 sec ( PyScripter is the default IDE I use now) - Delphi 20 .. 35 sec - Findstr 4 sec What order did you try try them in? Did you try each one more than once, in different orders? Just to rule out filesystem caching effects. I repeated all of them at least twice, to see if I got the same result. And indeed the very first run (PyScripter) was about 150 sec. So I think the above mentioned values give a good impression, nothing more. I'm really amazed by the speed of Python !! It can only be beaten by findstr, which is only available on windows. Did you try find -exec grep -F? well my windows version doesn't understand that : P:\Pythonfind /? Searches for a text string in a file or files. FIND [/V] [/C] [/N] [/I] [/OFF[LINE]] string [[drive:][path]filename[ ...]] /V Displays all lines NOT containing the specified string. /C Displays only the count of lines containing the string. /N Displays line numbers with the displayed lines. /I Ignores the case of characters when searching for the string. /OFF[LINE] Do not skip files with offline attribute set. string Specifies the text string to find. [drive:][path]filename Specifies a file or files to search. If a path is not specified, FIND searches the text typed at the prompt or piped from another command. cheers, Stef -- http://mail.python.org/mailman/listinfo/python-list -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
On Sep 29, 5:16 am, Lawrence D'Oliveiro [EMAIL PROTECTED]
central.gen.new_zealand wrote:
In message
[EMAIL PROTECTED], George
Sakkis wrote:
$ find -name *py | xargs egrep \bword\b
Better:
find -name '*.py' -exec grep -E \bword\b {} \;
In what way is this better ? I don't dispute it, I'm just curious.
--
http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ? (Python is slow ?)
Hi !
Thanks for return.
Some infos: from a long time, I found that it's often more fast to use
windows's command, instead of develop in high level language (and also,
low level...)
FINDSTR is fast. OK. But internal commands are more fast. Example : DIR
(with all his options)
And it's faster to read the result via a Pipe.
Thus, I use frequently this sort of function:
import os
def cmdone(repstart, commande, moderetour=LIST):
os.chdir(repstart)
sret=''.join(os.popen(commande))
if moderetour.upper() == STR:
return sret
else:
return sret.split('\n')
print cmdone('D:\\dev\\python','findstr /N /I ponx *.py','STR')
print
print cmdone('D:\\dev\\python','dir *.jpg /B')
Sorry for my bad english, and have a good day...
--
Michel Claveau
--
http://mail.python.org/mailman/listinfo/python-list
how to search multiple textfiles ?
hello, I want to search multiple textfiles (python source files) for a specific word. I can find all files, open them and do a search, but I guess that will be rather slow. I couldn't find any relevant information through google. Does anyone know of a search library that performs this task fast ? If it indeed only concerns py-files, is there another way of searching words ? ( I could imagine that such a py-only-search would have benefits, because you could set a flag to see the words in comment yes or no ) thanks, Stef Mientki Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in het handelsregister onder nummer 41055629. The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629. -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
On Sep 26, 8:35 am, Stef Mientki [EMAIL PROTECTED] wrote: hello, I want to search multiple textfiles (python source files) for a specific word. I can find all files, open them and do a search, but I guess that will be rather slow. I couldn't find any relevant information through google. Does anyone know of a search library that performs this task fast ? If it indeed only concerns py-files, is there another way of searching words ? ( I could imagine that such a py-only-search would have benefits, because you could set a flag to see the words in comment yes or no ) thanks, Stef Mientki Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in het handelsregister onder nummer 41055629. The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629. On Windows I use the free version of Bare Grep: http://www.baremetalsoft.com/baregrep/ No, it's not a Python solution, but it works for my needs. You should try using Python to search your script files and see if it really is too slow though. Mike -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
On Sep 26, 9:35 am, Stef Mientki [EMAIL PROTECTED] wrote: hello, I want to search multiple textfiles (python source files) for a specific word. I can find all files, open them and do a search, but I guess that will be rather slow. I couldn't find any relevant information through google. Does anyone know of a search library that performs this task fast ? If it indeed only concerns py-files, is there another way of searching words ? ( I could imagine that such a py-only-search would have benefits, because you could set a flag to see the words in comment yes or no ) If you're on *nix platform, you can use: $ find -name *py | xargs egrep \bword\b HTH, George -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
Hi! On Windows, you can use the (standard) command findstr Example: findstr /n /s /I strsearched *.py @-salutations -- Michel Claveau -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
Stef Mientki [EMAIL PROTECTED] writes: Does anyone know of a search library that performs this task fast ? You mean you want a Python search engine (with inverted indexes and all that)? Try: nucular.sf.net -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ?
On Sep 26, 6:35 am, Stef Mientki [EMAIL PROTECTED] wrote: hello, I want to search multiple textfiles (python source files) for a specific word. I can find all files, open them and do a search, but I guess that will be rather slow. I couldn't find any relevant information through google. Does anyone know of a search library that performs this task fast ? If it indeed only concerns py-files, is there another way of searching words ? ( I could imagine that such a py-only-search would have benefits, because you could set a flag to see the words in comment yes or no ) thanks, Stef Mientki Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in het handelsregister onder nummer 41055629. The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629. I use 'fgrep' ie... `fgrep -r toFind /source` ~Sean -- http://mail.python.org/mailman/listinfo/python-list
Re: how to search multiple textfiles ? (Python is slow ?)
Mike Driscoll wrote: On Sep 26, 8:35 am, Stef Mientki [EMAIL PROTECTED] wrote: hello, I want to search multiple textfiles (python source files) for a specific word. I can find all files, open them and do a search, but I guess that will be rather slow. I couldn't find any relevant information through google. Does anyone know of a search library that performs this task fast ? If it indeed only concerns py-files, is there another way of searching words ? ( I could imagine that such a py-only-search would have benefits, because you could set a flag to see the words in comment yes or no ) thanks, Stef Mientki Het UMC St Radboud staat geregistreerd bij de Kamer van Koophandel in het handelsregister onder nummer 41055629. The Radboud University Nijmegen Medical Centre is listed in the Commercial Register of the Chamber of Commerce under file number 41055629. On Windows I use the free version of Bare Grep: http://www.baremetalsoft.com/baregrep/ No, it's not a Python solution, but it works for my needs. You should try using Python to search your script files and see if it really is too slow though. hi guys, I did some tests and I'm amazed about the results: I did a search on the Python directory: 300 MB, 10325 files in 660 folders. I did several searches, with / without case-sensitive, whole words / not, many/few occurrences, but the differences between those were negligible. Finding all occurences with line numbers: - Pyscripter 110 sec ( PyScripter is the default IDE I use now) - Delphi 20 .. 35 sec - Findstr 4 sec With the following programs I only searched for the first occurence, which I think is good in the case of many files, because you can only view 20 or 30 lines in 1 screen. - Explorer XXX didn't find anything - FileNurse 5 sec (FileNurse is my own Explorer replacement, written in Delphi) - Python 3 sec (very quick and dirty procedure with string.find method I'm really amazed by the speed of Python !! It can only be beaten by findstr, which is only available on windows. Paul: nucular looks very promissing, but I couldn't get it working within a few minutes. I might also be a little overkill, but I'll certainly bookmark the link for future use. thanks again, cheers, Stef Mike -- http://mail.python.org/mailman/listinfo/python-list -- http://mail.python.org/mailman/listinfo/python-list
