On Mon, 2008-11-17 at 13:15 -0800, Astley Le Jasper wrote:
> Hi Giovanni,
>
> Thanks for your help.
>
> I have a number of site specific scraping scripts that are managed
> from a management script. The later is along the lines of:
>
> import imp
> import threading
>
> site_script_list = ('google','bbc','ebay','amazon')
> thread_dict = {}
> search_str = "something"
>
> for site in site_script_list:
> thread_list[site]=threading.Thread(name=site, target=run_all, args=
> (site,))
> thread_list[site].start()
>
> for site in thread_dict:
>
> thread_list[site].join()
>
> def run_all(site):
> f, filename, description = imp.find_module(site)
>
> sitemodule = imp.load_module(site, f, filename, description)
> results = sitemodule.get_search_results(search_str)
> archiveresults(results)
> etc etc ......
> Obviously it's a bit more complicated than this but it'll gives you
> the general idea.
I must be missing something: why don't you simply import all the
required modules and then use them?
===========================================================================
import site_google
import site_ebay
import site_bbc
site_names = [name for name in sorted(globals()) if name.startswith("site_")]
sites = [globals()[d] for d in site_names]
for s in sites:
run_all(s)
def run_all(site):
site.get_search_results(...)
[...]
===========================================================================
You still need to mention each site exactly once, but that's what you're
already doing AFAICT.
--
Giovanni Bajo
Develer S.r.l.
http://www.develer.com
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"PyInstaller" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at
http://groups.google.com/group/PyInstaller?hl=en
-~----------~----~----~----~------~----~------~--~---
