Re: how to parse a file with millions of records with protobuf

2008-12-08 Thread David Anderson
Do you really need to have the entire file in memory at once? Reading 64M of addresses into memory seems like the wrong approach (I could be wrong of course, since I don't know what you're doing with them). If you need to do something with each entry individually, you could do chunked reads:

Re: Performance comparison of Thrift, JSON and Protocol Buffers

2009-03-04 Thread David Anderson
On Thu, Mar 5, 2009 at 3:20 AM, Alain M. ala...@pobox.com wrote: Hi, I was reading this comparison yesterday and was woried about PB performance... But today I studied a little more about JSON and I would like to share this: JSON is not at all comparable with ProtBuf, it is much much

Re: abort() in libprotobuf due to missing required field

2009-03-24 Thread David Anderson
On Tue, Mar 24, 2009 at 4:11 PM, Caleb caleb.epst...@gmail.com wrote: On Mar 23, 7:16 pm, Kenton Varda ken...@google.com wrote: BTW, you should always compile with -DNDEBUG unless you are building a debug build.  It strips out several debug checks which makes things faster. Note that

[protobuf] Integrating protocol buffers into a Haskell Cabal package

2010-03-12 Thread David Anderson
Hi, I'm looking at using the Haskell implementation of protocol buffers in a project of mine, and I'm running into somewhat of a dearth of Haskell projects that actually use hprotoc and the related protocol buffer libraries. Specifically, to get started, I just want to integrate the building of

Re: [protobuf] ECCN

2010-07-10 Thread David Anderson
On Wed, Jul 7, 2010 at 2:55 PM, Chuck Knight chuck.a.kni...@gmail.com wrote: Does anyone have an ECCN (export control number) for this project? I don't think there is one. What makes you think one is needed? I thought that export control numbers for software were only required where cryptography