On Fri, Jul 4, 2014 at 10:37 AM, Gideon George <georgegid...@gmail.com>
wrote:

I want to create an awesome rss feed agregator like that of techi.com
> please is there any example of site that did it in web2py? Also I need
> suggestions on how to go about it.
> Thank you
>
>
>
I have my own personal feed agregator done in web2py. It's not an "awesome"
one but my
requirements were to not have images and to not have any javascript.
I want it to be fast and functional.
I currently have the load event and domcontentloaded event in chomium fired
in less than 400ms.
You can see it here: http://feeds.uni.me

from memory my setup is:

- nginx with uwsgi protocol, but not with uWSGI server. I implemented a
subset of
uwsgi protocol in pure python to be able to use eventlet (I think uWSGI
server doesn't support eventlet).

- sessions and cache are stored in redis.

- sqlite database. Currently it has near 300000 (~665Mb) articles in it.
One thing I learn is that sqlite is very slow to "select count(*) from
table",
I was using this query for pagination with pages,
than I change to only newer, older buttons to avoid the count(*).

- search is powered by whoosh and bottle - Web2py is querying through a
simple restful api.
I have 2 separated whoosh indexes, one for portuguese articles and the
other for english.

- a background job to collect and process the feeds,  than the feeds are
stored in sqlite and added to
whoosh index.

- perp (http://b0llix.net/perp/ - similar to daemontools) to control all
the pieces

- a small VPS with 256Mb of RAM.


Ricardo

-- 
Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
--- 
You received this message because you are subscribed to the Google Groups 
"web2py-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to web2py+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to