I assume most of us are using Cython because normal python is too slow
for our particular operation. I've been writing a compiler in python
which generates large graphs with ~600k nodes, and I'd like to
serialize/checkpoint these to disk for later stages of the compiler
pipeline to use. However, at the moment, it takes ~60 seconds to
serialize the resulting graph to disk with cPickle.
Have any Cython users found better/faster ways of serializing to disk? I
could potentially use the "marshal" module, but my understanding is that
it only works for built-in types, and of course, that the root of my
class hierarchy I have four cython classes. I'd love to avoid writing my
own serialize/deserialize methods, if at all possible.
I can't be the only person in this position,
Thanks,
...Eric
_______________________________________________
Cython-dev mailing list
[email protected]
http://codespeak.net/mailman/listinfo/cython-dev
