More Dynamic Python Accessors?

Hello, I've recently started using Google Protocol Buffers with Python on my server. I'm writing code to convert my data source into a binary payload, but I'm running into some snags and was wondering if there was a better way I'm not seeing in the documentation. Basically, I want a more dynamic

Python Installation without superuser

Hello, I'm trying to get GPB setup on a shared server environment, so I don't have the ability to run as the superuser. Is there a way to modify the installer (or link the Python files different) such that you can run GPB without needing to install to system directories or run as superuser? As a

Python - Appending repeated messages instead of merging

Hello, I'm finding that I am writing code that looks a lot like this: tmpsubmessage = parse_submessage_data() submessage = message.submessage.add() submessage.MergeFrom(tmpsubmessage) This seems inefficient to me. One alternative would be to create the new submessage, and fill it on the spot:

error when using nested and packed in python

() a_deserialized.ParseFromString(a_string) str(a_deserialized) I can think of three options to proceed, 2 of which I'm able to do myself: 1) don't use the packed=true option 2) catch the errors and ignore them 3) if this is actually a bug, ask you gurus to fix the protobuf code What do you

how to use protobuf with Google App Engine?

e howto or something like that somewhere that I missed? http://groups.google.com/group/protobuf/browse_thread/thread/6430dc5d7ceb145a/b8634dddbe4425f3?lnk=gst&q=gae#b8634dddbe4425f3 http://groups.google.com/group/google-appengine/browse_thread/thread/db910ed40

Re: how to use protobuf with Google App Engine?

;google" package.  Protocol Buffers has, from day one, declared the > package as a "namespace package" using setuptools, which theoretically > allows sharing of the package.  For things to work, though, AppEngine has to > cooperate by doing the same thing in their own code. > >

[protobuf] Streaming Dynamic Messages

Im trying to write the following client/server exchange using the Java Protobuf API: 1) Client makes a request to the server 2) Server creates a series of Messages all of the same type to stream back to the client. The type of the messages will be different depending on the parameters of the cli

[protobuf] Re: Regd: How do I represent java.util.Date in my .proto definition?

I use a dateFormatter to send it as a string. I suppose its also possible to send it as a int64 if you want. Just be wary of timezones. Dan On Nov 10, 3:25 pm, rahul prasad wrote: > How do I represent java.util.Date in my .proto definition? Is this > supported, or any other workarou

[protobuf] Re: Streaming Dynamic Messages

Yes! That works, thanks. On Nov 9, 8:37 pm, Kenton Varda wrote: > You want:  com.google.protobuf.Descriptors.FileDescriptor.buildFrom() > > > > On Mon, Nov 9, 2009 at 5:25 PM, Dan wrote: > > > Im trying to write the following client/server exchange using the Java &

[protobuf] File extension for data in protobuf format

What do you guys use for your file extension when writing data in protobuf format to a file? I'm guessing google doesn't use a file extension. -- You received this message because you are subscribed to the Google Groups "Protocol Buffers" group. To post to this group, send email to proto...@goog

[protobuf] Re: File extension for data in protobuf format

hat is inside, even if you know how it is encoded. > > > > On Wed, Dec 9, 2009 at 5:14 PM, Dan wrote: > > What do you guys use for your file extension when writing data in > > protobuf format to a file? I'm guessing google doesn't use a file > > extensio

[protobuf] What's the state of TextFormat?

Hi there. I'm wondering what the state of TextFormat support is in protocol buffers and if it is and will remain a fully supported option. Among other things, I'm thinking of using it as a way of storing configuration/state for objects in a message based system in an easy to read format that can

[protobuf] Handling streaming in Python

Hello, Does anyone have or can point me to an example of handling a stream of protobuf messages in python? Specifically what I'm trying to do is parse a stream that looks like the following ... The header just gives the list of field names and their types (int, double, or string, that's i

[protobuf] Re: Handling streaming in Python

/master/lib/py/zippylog/stre...an > >example (although I can't guarantee the Python code in that project > > works at this time). > > > Greg > > > -Original Message- From: Dan > > Sent: Tuesday, November 30, 2010 4:01 PM > > To: Protocol Buffe

[protobuf] .proto file with enumeration only

i have a .proto with nothing but an enumeration in it. it compiles, but the output .h and .cc file are basically empty stubs. i made a test file with enum foo { bar = 1; } and that compiles just fine... the file i'm having problems with is the essentially the same but has about 125 values.

[protobuf] Re: .proto file with enumeration only

solved it. apparently you can't have a comment as the first line of your file. On Feb 16, 11:40 am, dan wrote: > i have a .proto with nothing but an enumeration in it.  it compiles, > but the output .h and .cc file are basically empty stubs.  i made a > test file with > >

[protobuf] Re: .proto file with enumeration only

commented out in the middle of the enumeration like so: enum foo { bar = 1; // baz = 2; } On Feb 16, 1:53 pm, dan wrote: > solved it.  apparently you can't have a comment as the first line of > your file. > > On Feb 16, 11:40 am, dan wrote: > > > > > > > &

[protobuf] Compiler issue when using FileDescriptor set in my own message

e made, it looks like the method should have been defined in descriptor.pb.h. It is not, and it does not appear that I should try to compile descriptor.proto myself. I am using version 2.4.1 of the protobuf library, and as you've probably guessed, trying to compile C++. Any ideas on how

[protobuf] DescriptorPool: call to FindFileByName() required before call to FindMessageTypeByName()?

le to setup a SourceTreeDescriptorDatabase to a directory that contains all of the .proto files I plan to use and not have to search for each file individually. Any advice is much appreciated. thanks, Dan string sProtoRoot("/home/dan/tests/new-protobuf/protos"); DiskSourceTree d

Re: [protobuf] Compiler issue when using FileDescriptor set in my own message

and made the import statement relative as you suggested the problem was resolved. -Dan On Monday, June 4, 2012 5:26:35 PM UTC-7, Jason Hsueh wrote: > > The issue is import paths - the pre-generated versions of > descriptor.pb.{h,cc} are generated relative to the source root. Instead of > i

Re: [protobuf] DescriptorPool: call to FindFileByName() required before call to FindMessageTypeByName()?

to load all of them, and we have > clients specify the leaf file explicitly. > > On Wed, May 30, 2012 at 1:16 PM, Dan wrote: > >> Hi, >> In the code below, I've found that the returned Descriptor* is NULL after >> I call FindMessageTypeByName(), *unless* I fir

[protobuf] Re: nooby question: output file extension from protoc

Digging through the source code, there's a function called CppGenerator::Generate in src/google/protobuf/compiler/cpp/cpp_generator.cc that has the extensions. You could change there the .cc to .cpp. A patch to allow the extension would be nice, I guess. Not sure how straight-forward it'd be.

Re: [protobuf] Invitation to connect on LinkedIn

Yes sir, as you can see from my LinkedIn profile, I know C++, Java, Python and Ruby. Why, just last weekend I went to Ruby's house for a BBQ and pool party... On Mon, Feb 22, 2010 at 4:28 PM, Henner Zeller wrote: > Wow, that elevates protocol buffers to be a real person ;) > > -- > You received

[protobuf] Streaming results from a repeated field in Java

time, instead of all of them at once. Is there a way to do this using the Java API? If so can you share an example of how to do so? Thanks! Dan -- You received this message because you are subscribed to the Google Groups "Protocol Buffers" group. To unsubscribe from this grou

[protobuf] Protobuf python packaging conflicts with AppEngine packaging

I ran into an issue today with AppEngine imports and noticed that it was being caused by the PiPy package of protobufs. Since the Google protobuf package and the Google AppEngine package share the same google.* module, if the protobuf package is installed, all appengine imports fail due to the

[protobuf] Why can't enums be used as map keys?

The protobuf3 language guide says If you want to create an associative map as part of your data definition, protocol buffers provides a handy shortcut syntax: map map_field = N; ...where the key_type can be any integral or string type (so, any scalar

[protobuf] printing typenames with DebugString with C++

I'm using DebugString() in C++ to pretty print google protobuf messages read in binary form, and converted using ParseFromIstream(). Its only printing the type name at the top level, and for all levels, its just printing the type number. I am using extensions. is that the reason for the ref

[protobuf] PHP GTFS-RT parsing .proto extension data

ude them to have the parse() function find them, but I've tried a lot of different combinations and I think I'm stuck. How do I get the FeedMessage->parse() function to find my new classes? Any help is appreciated! -Dan -- You received this message because you are subscribed to the

[protobuf] reducing external dependencies on per language basis in protobuf defintion files

Some packages have additional options specified on per language basis: For example: syntax = "proto3" package anexample; ... import "gogoproto/gogo.proto"; option (gogoproto.marshaler_all) = true; option (gogoproto.unmarshaler_all) = true; ... Note, that when building this for a mixed language e

[protobuf] Help Requested: error C3646: 'noexcept' unknown override specifer

t be? Has anyone run into a similar issue? Thank you, Dan -- You received this message because you are subscribed to the Google Groups "Protocol Buffers" group. To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+unsubscr...@googl

Re: [protobuf] Help Requested: error C3646: 'noexcept' unknown override specifer

gt; On Tue, Sep 10, 2019 at 1:31 PM Dan Morin wrote: > >> Hello, >> >> I'm attempting to install Protobuffers Version 3.6.1 on a windows 7 >> machine. I've reached the 'nmake' step after the multiline cmake command, >> and am using the command pr

[protobuf] Preferred Citation?

{\url{http://code.google.com/apis/protocolbuffers/}}, } but I'm sure that the authors list is woefully incomplete. Is there a more complete list of authors available? Alternatively, I could just put the project's URL in a footnote. - Dan -- You received this message because you are subscribed

Re: [protobuf] gcc 4.7.0 compile error with -std=c++11

On Tuesday, July 3, 2012 1:53:20 AM UTC-4, liujisi wrote: > The internal version is already c++11 compatible. It will be included in the > next release. > > > On Fri, Apr 20, 2012 at 4:23 PM, Brian Nesbitt wrote: > > Hello folks, > > > Protobuf 2.4.1 fails to build using gcc 4.7.0 (on CentOS

[protobuf] Please add 'Wire' to ThirdPartyAddOns page

oid or other constrained Java environments and is Apache-licensed. Thanks, Dan -- You received this message because you are subscribed to the Google Groups "Protocol Buffers" group. To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+unsubscr..

[protobuf] ProtoBuf file larger than CSV

I have a 48mb CSV file with 200,000 records and 37 string columns. I used protobuf to write the same 200,000 records to a .bin file, and the .bin file is about 60mb. Is this expected? I thought the protobuf file would be smaller. -- You received this message because you are subscribed to th

Re: string vs. bytes

that I'm losing efficiency because serialising to string might mean that I'm losing my raw data. Otherwise, then the word ERROR on the output might be a bit too strong. If anybody can clarify, I'd be very grateful. Dan On May 10, 5:59 pm, Henner Zeller wrote: > On Sun, May 10, 20

Re: string vs. bytes

would be the case for using serialisation to a stream then? Thanks again for the help. Dan On May 12, 5:26 pm, Kenton Varda wrote: > Protocol Buffers has a "bytes" type.  That's what it's talking about.  Just > change "string" to "bytes" in your .pr

Re: string vs. bytes

Thanks a lot for that response, and sorry for taking this long to reply. We've got small messages just now, so we're going to stick with the serialisation to strings. Dan On May 12, 8:19 pm, Kenton Varda wrote: > The serialized message is just an array of bytes.  We use std:

libprotobuf ERROR google/protobuf/message.cc:121

error... Anyway, thanks for any thoughts on that. Oh, and the response to this post is going to settle who gets to hold the TV remote at the office, so this is important stuff ;) Regards, Dan --~--~-~--~~~---~--~~ You received this message because you are su

Re: libprotobuf ERROR google/protobuf/message.cc:121

? Many thanks again. Dan On May 22, 5:44 pm, Kenton Varda wrote: > You can capture log output using > SetLogHandler():http://code.google.com/apis/protocolbuffers/docs/reference/cpp/google... > > <http://code.google.com/apis/protocolbuffers/docs/reference/cpp/google...>How

Re: libprotobuf ERROR google/protobuf/message.cc:121

Thanks a lot for the time spent on this topic. Really appreciate it. I think we will end up using your optional message suggestion. There's several places where the amount of messages might get us into trouble in the future. Once again thank you. Dan On May 22, 10:14 pm, Kenton Varda

Re: [protobuf] How could I get service, rpc request & response, message types at runtime?

I would suggest that you include the type of request/response in your messages. You could perhaps have an enum with your message types and that way you can check once you parse the message. Of course this means that you might need to use optionals for the payload of your message. Parsing to identif

Re: [protobuf] nooby question: output file extension from protoc

Don't know about the internals, but it should be quite easy to write a script round the command that renames after the generation of the file. On 5 December 2013 22:07, Anthony Glaser wrote: > By default the protoc commands outputs a file with an extension of .pb.cc > from a file foo.proto with