On Tue, Jan 20, 2009 at 7:27 PM, Tim Arnold <[email protected]> wrote:
> I had the same problem you did, but then I changed the code to create a new
> soup object for each file.That drastically increased the speed. I don't
> know why, but it looks like the soup object just keeps getting bigger with
> each feed.
>
> --Tim
>
> I have found the actual solution for this problem.
I tried using *BeautifulSoup.SoupStrainer()* and it improved memory
usage to the
greatest extent.Now it uses max of 20 MB(earlier
it was >800 MB on 1GB RAM system).
thanks all.
--
Yours,
S.Selvam
--
http://mail.python.org/mailman/listinfo/python-list
