John M Camara wrote: > Adam Jones wrote: > > I'm thinking about putting together a site that pulls the "last 50 > > threads" feed off Google Groups and uses it as a basis. Then from there > > I can access a thread directly, write a summary on the site, then when > > finished click go to generate the full summary. Only problem is that we > > could conceivably get >50 threads between lookups. > > > I wrote a script about a week ago that I used to grab all the topic > titles, original authors, date, number of messages, and links to the > threads for all the topics in this group. I just used httplib to fetch > the pages and BeautifulSoup to extract the info. If your interested in > I can send you the code.
The more I think about it just biting the bullet and dealing with an email-based solution might be the best idea. My concern is that by pulling the data in through whatever means I will end up missing something due to extreme volume or a server outage. I'm giving myself until Monday to start the summaries (hopefully you do catch this Steve!) so I will see what can be done by then. -Adam --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TurboGears" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/turbogears?hl=en -~----------~----~----~----~------~----~------~--~---

