Re: [protobuf] Protocol Buffers Python extension in C

2011-02-01 Thread Atamurad Hezretkuliyev
I've implemented code generator so others can test / use our C implementation in Python. Another new thing is Lazy decoding support. Message are decoded on the fly as attributes are accessed for the first time. More info: http://blog.connex.io/introducing-cypb-improving-the-performance-of You

Re: [protobuf] Protocol Buffers Python extension in C

2011-01-08 Thread Evan Jones
On Jan 7, 2011, at 6:36 , Atamurad Hezretkuliyev wrote: Currently our basic deserializer module is 17x faster than Google's implementation in pure Python. The pure python code is pretty slow. However, the repository version (and the newly released 2.4.0 rc 1?) has C++ code to do

Re: [protobuf] Protocol Buffers Python extension in C

2011-01-08 Thread Atamurad Hezretkuliyev
Following Evan's advice, I've run experiment using the repository version. According to my test, Google's C++ parser code is 7.6 times faster than pure python, which is consistent with Yang's results. Our C decoder is twice faster than google's c++ extension. I've pushed the updated code and

[protobuf] Protocol Buffers Python extension in C

2011-01-07 Thread Atamurad Hezretkuliyev
Hey there, We at connex.io use Protocol Buffers quite heavily, 1) as client-server communication protocol, and 2) to store objects in our key-value database. When processing requests server-side by the Python application, I've discovered that ~30% of CPU usage goes to deserializing PB messages.