JuHui a écrit :
in fact, I want to do a script to get news on others site.
Then ask the webmasters of theses sites if they do have a ress feed...
--
http://mail.python.org/mailman/listinfo/python-list
Hi
I want to get 20 html pages content from one server, you know
urllib.urlopen need construct network connection, it will be very
slowly, how to speed up this function?
I try to using multi-thread, it speed up, but I want to quickly more,
any idea about it?
Thanks!
--
On Mar 15, 2006, at 11:22 AM, JuHui wrote:
Hi
I want to get 20 html pages content from one server, you know
urllib.urlopen need construct network connection, it will be very
slowly, how to speed up this function?
I try to using multi-thread, it speed up, but I want to quickly more,
JuHui wrote:
Hi
I want to get 20 html pages content from one server, you know
urllib.urlopen need construct network connection, it will be very
slowly, how to speed up this function?
I try to using multi-thread, it speed up, but I want to quickly more,
any idea about it?
Thanks!
...
I will do it later. but i want to optimize the script first.
after useing muti-thread, the time speed up from 8s to 2.3s per page.
any other suggestions?
--
http://mail.python.org/mailman/listinfo/python-list
JuHui wrote:
Hi
I want to get 20 html pages content from one server, you know
urllib.urlopen need construct network connection, it will be very
slowly, how to speed up this function?
I try to using multi-thread, it speed up, but I want to quickly more,
any idea about it?
Thanks!
JuHui wrote:
Hi
I want to get 20 html pages content from one server, you know
urllib.urlopen need construct network connection, it will be very
slowly, how to speed up this function?
I try to using multi-thread, it speed up, but I want to quickly more,
any idea about it?
Thanks!
in fact, I want to do a script to get news on others site.
I must use script get the content and analyze the html code, where is
the title, where is the body
so, I can't ask permission, use wget and Physically remove the
harddrive and reinstall it locally
:)
--
On Mar 15, 2006, at 11:58 AM, JuHui wrote:
in fact, I want to do a script to get news on others site.
I must use script get the content and analyze the html code, where is
the title, where is the body
so, I can't ask permission, use wget and Physically remove the
harddrive and reinstall