Héllo again, 2013/4/9 Amirouche Boubekki <[email protected]>
> Héllo, > > I'm working on porting a redis clone to pypy-stm [1]. > > I did some benchmark, the interesting code is [2]. it runs 5 thread both > on sides client/server, it might be much, what do you think ? I have 4 > cores. > > (memo-stm)amirouche@funfev13 ~/src/Memo/client (pypy-stm*) $ time python > test_client_threaded.py > start training > training done > start spellchecking > 1181 out of 4236 > > real 34,81s > user 12,76s > sys 0,40s > > (memo-stm)amirouche@funfev13 ~/src/Memo/client (pypy-stm*) $ time python > test_client.py > start training > training done > start spellchecking > 1181 out of 4234 > > real 61,22s > user 5,69s > sys 0,87s > > I'm thinking about implementing other algorithms; no sure what yet > probably bloom filters or bit arrays but I don't have right now a usecase > in mind. > > I also started Graph database [3] which AFAIK should work and which also > has even if MVCC some atomic call to be used, the test I'm aiming with this > one is loading a wikipedia. > > How can I help you better ? > > > Thanks. > > > Amirouche > > > [1] https://github.com/amirouche/Memo/tree/pypy-stm > [2] a simple suggestion algorithm: > https://github.com/amirouche/Memo/blob/pypy-stm/server/memo/structures/suggest.py > [3] http://blog-amirouche.dotcloud.com/notes/projects/graphitidb.html > I did another benchmark with 2 thread both sides, numbers are... different: (memo-stm)amirouche@funfev13 ~/src/Memo/client (pypy-stm*) $ time python test_client_threaded.py start training training done start spellchecking 1181 out of 4236 real 14,66s user 5,79s sys 0,60s (memo-stm)amirouche@funfev13 ~/src/Memo/client (pypy-stm*) $ time python test_client.py start training training done start spellchecking 1181 out of 4234 real 12,63s user 5,49s sys 0,66s Also even if I've written it's redis clone, it's not quite as useful as Redis but I though that it could be useful to test pypy stm, HTH, Amirouche
_______________________________________________ pypy-dev mailing list [email protected] http://mail.python.org/mailman/listinfo/pypy-dev
