Re: [protobuf] Google Protocol buffers and Global Keys

2011-02-23 Thread Jason Hsueh
Extensionshttp://code.google.com/apis/protocolbuffers/docs/proto.html#extensionsare commonly used to allow other parties to independently add fields to a message. To avoid tag number collisions, you can assign each company a separate extension range. On Wed, Feb 23, 2011 at 5:06 AM, clayton

[protobuf] Re: New protobuf feature proposal: Generated classes for streaming / visitors

2011-02-07 Thread Jason Hsueh
I'm starting to look at the patch (meant to start end of last week but got caught up in other stuff) On Tue, Feb 1, 2011 at 9:30 PM, Kenton Varda ken...@google.com wrote: On Tue, Feb 1, 2011 at 3:17 PM, Jason Hsueh jas...@google.com wrote: Conceptually this sounds great, the big question

Re: [protobuf] Re: Generate .proto file from FileDescriptor?

2011-02-07 Thread Jason Hsueh
I'm not aware of anything in the Java library that provides this functionality. On Fri, Feb 4, 2011 at 6:45 AM, Ben Wright compuware...@gmail.com wrote: Anyone know if this can be accomplished without resorting to JNI? On Feb 3, 4:01 pm, Jason Hsueh jas...@google.com wrote: C++'s

Re: [protobuf] Re: Compilation error for ppc/440 target

2011-02-07 Thread Jason Hsueh
Yes, this code was added in 2.4.0. On Fri, Feb 4, 2011 at 7:06 AM, dear chap dear.c...@gmail.com wrote: Unfortunately we have to use the particular compiler in question and cannot upgrade. Is the DescriptorBuilder::OptionInterpreter::AggregateOptionFinder new code ? I dont see this problem

Re: [protobuf] Error with Netty and extensions

2011-02-07 Thread Jason Hsueh
On Sun, Feb 6, 2011 at 12:50 PM, Marco@worldcorp mmistr...@gmail.comwrote: snip Do i need to somehow declare extensions whenever i register my ProtocolDecoder / ProtocolEncoder? I don't know what ProtocolDecoder/ProtocolEncoder are, but yes, you need to provide an ExtensionRegistry to the

Re: [protobuf] where is input_stream.py?

2011-02-04 Thread Jason Hsueh
This file was deleted as part of the python serialization optimizations that were released in 2.3.0. A lot of the functionality now exists in decoder.py. You shouldn't be relying on internal parts of the package though, so it should only serve as a reference point for you. On Fri, Feb 4, 2011 at

[protobuf] Re: New protobuf feature proposal: Generated classes for streaming / visitors

2011-02-01 Thread Jason Hsueh
Conceptually this sounds great, the big question to me is whether this should be implemented as an option in the compiler or as a separate plugin. I haven't taken a thorough look at the patch, but I'd guess it adds a decent amount to the core code generator. I have a preference for the plugin

Re: [protobuf] ProtocolBuffers and existing classes

2011-01-25 Thread Jason Hsueh
No, you cannot refer to arbitrary classes. Doing so would be difficult to support across languages, and significantly complicates features like reflection. On Tue, Jan 25, 2011 at 6:39 AM, Marco@worldcorp mmistr...@gmail.comwrote: Hello i was wondering if protobuffer supports having an

Re: [protobuf] Re: cannot get extensions from serialized proto -- please help

2011-01-25 Thread Jason Hsueh
pm, Jason Hsueh jas...@google.com wrote: You didn't provide a code snippet, so it's hard to say, but I would guess that you need to provide an ExtensionRegistry and pass that to the parsing method. (It looks like you are working in Java) e.g. ExtensionRegistry extensionRegistry

Re: [protobuf] [ANN] Beefcake - A sane Ruby ProtoBuf library

2011-01-25 Thread Jason Hsueh
Added to the wiki, thanks for contributing! On Sat, Jan 22, 2011 at 12:46 PM, blake.mizer...@gmail.com wrote: I'm please to give the Ruby developers here Beefcake. https://github.com/bmizerany/beefcake/tree/master/lib/beefcake I would appreciate it if someone would list this on the

Re: [protobuf] cannot get extensions from serialized proto -- please help

2011-01-21 Thread Jason Hsueh
You didn't provide a code snippet, so it's hard to say, but I would guess that you need to provide an ExtensionRegistry and pass that to the parsing method. (It looks like you are working in Java) e.g. ExtensionRegistry extensionRegistry = ExtensionRegistry.newInstance();

Re: [protobuf] Dealing with Corrupted Protocol Buffers

2011-01-21 Thread Jason Hsueh
It will be rather difficult to correct for the error. The point at which the parse fails may not be the point of corruption: e.g., the corruption may be in a byte that is part of a varint, and the continuation bit may be set when it shouldn't. Similarly you could have a corruption in the length

Re: [protobuf] Problem with accents in python while unpacking a message

2011-01-21 Thread Jason Hsueh
Can you provide a small, self-contained reproduction of the program? On Thu, Jan 20, 2011 at 10:39 AM, Louhike louh...@gmail.com wrote: Hi, I'm using Google Protobuf with python on a project. My problem is I get an error while my program tries to build an instance with the function

Re: [protobuf] message forward declaration

2011-01-21 Thread Jason Hsueh
There are many things that need to be read from imported .proto files to determine if the .proto is valid, or to produce correct code. e.g.: - need to differentiate between enum and message imports - when referencing a qualified type like foo.bar.Baz.Qux, you need to know what components are

Re: [protobuf] I have a program use protobuf, and I wan't use this program in a machine which hasn't install protobuf, how can I do this?

2011-01-19 Thread Jason Hsueh
Add -static to your ld command to link the program statically. On Wed, Jan 19, 2011 at 12:38 AM, triStone liulei1...@gmail.com wrote: When I use this program in another computer, it reminder me that error while loading shared libraries: libprotobuf.so.6: cannot open shared object file: No

Re: [protobuf] strange behavior while parsing an extension

2011-01-13 Thread Jason Hsueh
You are parsing the serialization as a RefundRequest, not a Request. The 1 that is being returned is the value of the api_call field - on the wire this looks like the order_id field - both have tag 1 and are varint encoded. On Thu, Jan 13, 2011 at 8:58 AM, Simeon Mitev

Re: [protobuf] strange problem while parsing an extension

2011-01-13 Thread Jason Hsueh
See other thread On Thu, Jan 13, 2011 at 3:37 AM, Simeon Mitev simeon.mi...@alegram.comwrote: Hi all, I have a strange behavior with java release 2.3.0 and I need your help: Protos.proto: ... message Request { required Api api_call = 1; extensions 100 to 200; } message

Re: [protobuf] Re: how to deal with the byte 0xFF in the business logic?

2011-01-13 Thread Jason Hsueh
As Adam said, -1 has a representation that is not just a single 0xFF. To decode a varint, you have to read the bytes until the most significant bit is 0. (See http://code.google.com/apis/protocolbuffers/docs/encoding.html#varints) Note that int32 values are sign-extended for wire compatibility

Re: [protobuf] compile protobuf with gcc2.96

2011-01-13 Thread Jason Hsueh
This compiler is 10 years old, and apparently is not even an official release: http://gcc.gnu.org/gcc-2.96.html. You should upgrade to a newer version. On Thu, Jan 13, 2011 at 9:20 AM, Pinakin Mevawala pmevaw...@gmail.comwrote: Not able to do so. Any help? [root@localhost protobuf-2.3.0]#

Re: [protobuf] Re: Nested messages using C++

2011-01-13 Thread Jason Hsueh
On Thu, Jan 13, 2011 at 5:38 PM, Linus suram.su...@gmail.com wrote: I am new to PB and I just ran into this. Is it possible that the PB compiler does not generate set_... methods for some nested messages? Here is an example: I don't see set_... methods for ANY of the parameters in the db

Re: [protobuf] Re: Nested messages using C++

2011-01-13 Thread Jason Hsueh
By the way this is documented here: http://code.google.com/apis/protocolbuffers/docs/reference/cpp-generated.html#fields On Thu, Jan 13, 2011 at 5:42 PM, Jason Hsueh jas...@google.com wrote: On Thu, Jan 13, 2011 at 5:38 PM, Linus suram.su...@gmail.com wrote: I am new to PB and I just ran

Re: [protobuf] Deserialize messages from CodedInputStream without a message size prefix

2010-12-12 Thread Jason Hsueh
You should be using toByteArray(), not getBytes(), to serialize to the protobuf wire format. You also need to delimit the messages. Otherwise, the first ParseFromCodedStream call will consume as many bytes as are available in the byte array. On Sun, Dec 12, 2010 at 10:13 PM, Fishtank

[protobuf] Re: Float Scalar Type

2010-12-08 Thread Jason Hsueh
Yup. On Wed, Dec 8, 2010 at 11:31 AM, quickRiposte quickripo...@gmail.comwrote: Is the GPBUF Float the equivalent of the IEEE754 Float (i.e. 4 bytes)? -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To post to this group, send email to

Re: [protobuf] Submitting a Patch for Google Protocol Buffers

2010-11-19 Thread Jason Hsueh
Hate to tell you this, but this looks pretty much identical to the TextFormat (text_format.{cc,h}) that's already provided by the library (and the wrapper methods Message::DebugString() and friends). Or are you using lite mode, which doesn't support this because it's reflection based? (Generating

Re: [protobuf] memory usage problem of using a group record

2010-11-18 Thread Jason Hsueh
Well, that depends on how you set up your map. You could instead make the key a pointer to the protobuf field, and define your comparator so that it dereferences the pointer. Of course you need to make sure that the pointer is actually valid: if you mutate the field you may invalidate the pointer.

Re: [protobuf] Renaming Fields

2010-11-18 Thread Jason Hsueh
Yes, renaming fields is a wire compatible change. You might break things that use human readable formats like TextFormat, and of course any code that references the old field name. On Thu, Nov 18, 2010 at 1:56 PM, Cameron cameron.develo...@gmail.comwrote: I'm pretty sure I already know the

Re: [protobuf] Parse from a iterator range possible?

2010-11-15 Thread Jason Hsueh
It should be pretty straightforward to implement an io::ZeroCopyInputStream that provides the byte stream using these iterators. On Mon, Nov 15, 2010 at 1:30 PM, idleman evoo...@gmail.com wrote: Hello everyone, I am just wondering if it should be possible to parse from a iterator range? Say

Re: [protobuf] Re: Dynamic Message

2010-11-05 Thread Jason Hsueh
On Fri, Nov 5, 2010 at 3:26 PM, AdamM adammaga...@gmail.com wrote: Is there a way to return the entire extension part of the message into a separate message like: message Foo { extensions 100 to 199; } message Baz { extend Foo { optional int32 bar = 126; } } In C++ Code:

Re: [protobuf] Odd behavior while deserializing PB

2010-11-02 Thread Jason Hsueh
You can't just parse any message type into *DescriptorProto. Those are protocol buffers which represent the type definition of other protocol buffers (e.g. your Request msg). You want to use DynamicMessage in order to operate on generic messages. On Wed, Oct 27, 2010 at 9:55 AM, maninder batth

Re: [protobuf] Serialize message in C++, parse using Java

2010-10-28 Thread Jason Hsueh
On Wed, Oct 27, 2010 at 11:50 AM, Jun8 ctaski...@gmail.com wrote: I've Google for a day now and could not find full information on the following problem. I want to serialize protobuf messages in C++, send them to a JMS (using activemq-cpp API) and parse in my Java server. Based on what I

Re: [protobuf] New Ruby Protocol Buffers library

2010-10-28 Thread Jason Hsueh
Looks like Kenton didn't get around to this, so I added it to the wiki. On Wed, Oct 27, 2010 at 11:48 AM, Brian Palmer br...@codekitchen.netwrote: I think just the github page for the project would be great. Thanks! http://github.com/mozy/ruby-protocol-buffers -- Brian On Oct 26, 2010, at

Re: [protobuf] DescriptorPool::BuildFile() seems not parsing nested messages in order

2010-10-08 Thread Jason Hsueh
On Thu, Sep 23, 2010 at 10:37 PM, Jason Hsueh jas...@google.comwrote: On Thu, Sep 23, 2010 at 9:52 AM, Himanshu Srivastava him.s...@gmail.com wrote: Hi Jason, In code: //// DescriptorPool descriptor_pool; for (int i = 0; i

Re: [protobuf] Regarding various concepts in google protocol buffers.

2010-10-07 Thread Jason Hsueh
On Fri, Sep 24, 2010 at 2:21 PM, Raghav raghav.swa...@gmail.com wrote: Hi I am new to learning google protocol buffers. I have following questions on my mind when I went throught all te content availiable on website. 1. What should I know for learning google protocol buffers. I mean is

Re: [protobuf] Python installation does not build plugin_pb2

2010-10-07 Thread Jason Hsueh
As Kenton said, including plugin.proto would bloat the core library. Only people implementing proto compilers such as yourself need to use it. On the C++ side, you would typically just build a statically linked binary that has all of the plugin generated code linked in. It's not included in the

Re: [protobuf] Re: Best Practices

2010-10-07 Thread Jason Hsueh
On Thu, Oct 7, 2010 at 5:29 AM, users moofis...@gmail.com wrote: Thank you Kenton and Jason for the advice. I have a couple more questions as I move forward with PB implementations. In the documentation it states that PBs don't make good first class citizens in an OO domain model and

Re: [protobuf] Feature proposal: mapped fields

2010-10-07 Thread Jason Hsueh
On Thu, Oct 7, 2010 at 7:02 PM, Igor Gatis igorga...@gmail.com wrote: On Thu, Oct 7, 2010 at 6:19 PM, Jason Hsueh jas...@google.com wrote: Indeed, maps have been brought up repeatedly. I forget the current state of the discussion, but I think it's generally agreed that it would be a good

Re: [protobuf] Java Protobuf Extension

2010-09-30 Thread Jason Hsueh
In Java, you need to make sure that you provide an ExtensionRegistry when you parse the message. You will need to create an ExtensionRegistry instance, add the extensions that you want to access, and then pass it to mergeFrom/parseFrom. Otherwise, the extensions will just get treated as an unknown

Re: [protobuf] Re: import statement

2010-09-26 Thread Jason Hsueh
You typically want to specify imports relative to your project root, and run protoc from that directory. Then the includes would be generated as #include pathCommon/CommonMsgs.pb.h (I'm assuming you have your project's root in the include path for your compiler) On Fri, Sep 24, 2010 at 9:58 AM,

Re: [protobuf] Re: Why ParsePartialFromZeroCopyStream consumes all the data?

2010-09-24 Thread Jason Hsueh
Yes, this behavior is normal. The wire format is not self delimiting, so there's no way to tell when one message ends and another starts. http://code.google.com/apis/protocolbuffers/docs/techniques.html#streaming As you mentioned, you can use ParseFromBoundedZeroCopyStream to restrict the number

Re: [protobuf] DescriptorPool::BuildFile() seems not parsing nested messages in order

2010-09-23 Thread Jason Hsueh
on public domain, though. Thanks and Regards, Himanshu On Thu, Sep 23, 2010 at 7:53 AM, Jason Hsueh jas...@google.com wrote: It occurred to me that protoc shouldn't accept your file either. Did it really compile successfully? What do you actually get in your FileDescriptorSet

Re: [protobuf] DescriptorPool::BuildFile() seems not parsing nested messages in order

2010-09-22 Thread Jason Hsueh
1) I would guess the problem is that the action message type refers to undefined types eaction_type and ereason. There are probably error messages farther up indicating that action could not be built. Because action isn't a valid type, RecordHeader can't refer to it, and thinks that action is an

Re: [protobuf] DescriptorPool::BuildFile() seems not parsing nested messages in order

2010-09-22 Thread Jason Hsueh
It occurred to me that protoc shouldn't accept your file either. Did it really compile successfully? What do you actually get in your FileDescriptorSet? On Wednesday, September 22, 2010, Jason Hsueh jas...@google.com wrote: 1) I would guess the problem is that the action message type refers

Re: [protobuf] Does protobuf work in Visual Studio 2008 Express?

2010-09-20 Thread Jason Hsueh
MSVC has different versions of STL: it appears it may change between compiler versions, and also between debug and release, even for the same compiler version. You need to make sure that you build your project with the same C runtime as the probouf lib. Here are some past threads on the issue:

Re: [protobuf] Re: Java build having trouble with imports

2010-09-15 Thread Jason Hsueh
was forbar.StringMap. The protos were made and compiled first for .Net which seem to work with the file reference.member The Java compiler wanted package.member. thanks for the help. On Sep 10, 12:30 pm, Jason Hsueh jas...@google.com wrote: Yes, imports are paths, so use import com/foo/bar/some.proto

Re: [protobuf] Best Practices

2010-09-15 Thread Jason Hsueh
Different people have different opinions on this. There are cases where required may work fine, and with care, you can even change a required field to an optional one. However, required field checking has led to some significant problems in the past, so many advocate avoiding required altogether.

Re: [protobuf] Trouble compiling 2.3.0 (Segmentation fault)

2010-09-15 Thread Jason Hsueh
Hmm, a lovely ICE in gcc. You might try filing a bug with them or checking to see if there are known issues with Mingw32's gcc. I don't know of an easy way to omit python support. A quick hack would be to just modify python_generator.cc to be empty, which would hopefully get rid of the error. On

Re: [protobuf] Re: Java build having trouble with imports

2010-09-10 Thread Jason Hsueh
Yes, imports are paths, so use import com/foo/bar/some.proto; The paths need to be specified relative to the --proto_path, not the location of the file with the import statement. On Fri, Sep 10, 2010 at 6:40 AM, users moofis...@gmail.com wrote: Have you tried putting the import path in

Re: [protobuf] .proto file version constant

2010-09-10 Thread Jason Hsueh
Can you provide a small reproduction of the problem? A couple common errors: - custom options need to be specified as option (option_name) = value; (parentheses around the identifier) - if you're using the option in a different package than the one in which its defined, it needs to be qualified

Re: [protobuf] C++ bytes fields access problem

2010-09-07 Thread Jason Hsueh
Can you provide a small reproduction of the problem? The generated code should not be doing any UTF8 validation. Is it possible you have a field defined elsewhere that has type 'string'? On Tue, Sep 7, 2010 at 4:40 AM, Mk kuznetsov.m...@gmail.com wrote: Hi. I get funny problem. In proto file I

Re: [protobuf] Java reflection package resolution

2010-09-07 Thread Jason Hsueh
I'm confused. You mention using pure Java reflection, yet you also said you are trying to do some stuff with protobuf reflection. You should not be using Java reflection at all. To get the field type, as defined in the .proto file, use FieldDescriptor.getType() On Tue, Sep 7, 2010 at 6:29 AM,

Re: [protobuf] Scala protocol buffers protoc plugin

2010-09-07 Thread Jason Hsueh
Default values for required fields do mean that: use the default if not explicitly set. This only affects the in-memory object, though - IsInitialized() will still fail if a required field is not set. However, such a proto would be usable by a client that does not do required field checking by

Re: [protobuf] Re: Get enum as string in Python

2010-08-26 Thread Jason Hsueh
Oh, indeed enum_types_by_name is what you want - my bad! On Thu, Aug 26, 2010 at 5:51 PM, Mike mspie...@gmail.com wrote: Got it, Thanks! In your first statement, I believe the method is actually enum_types_by_name - at least that's what worked for me. On Aug 26, 12:29 am, Jason Hsueh jas

Re: [protobuf] Combing multiple messages of only builtin C++ types

2010-08-25 Thread Jason Hsueh
If you want to serialize them as one message, make your definition do exactly that: message CombinedTypes { optional int32 int32_val = 1; optional double double_val = 2; optional float float_val = 3; } Note that you can make the code generator produce effectively the same code you describe

Re: [scala] [protobuf] [ANN] scala protobuf builder 0.1

2010-08-25 Thread Jason Hsueh
I added this to the ThirdPartyAddOns wiki as well. Thanks for contributing to the protobuf community! On Thu, Aug 19, 2010 at 3:09 AM, Eugene Vigdorchik eugene.vigdorc...@gmail.com wrote: Hi all, I'm pleased to announce the birth of scala-protobuf project. You can find the sources at

Re: [protobuf] Reusing proto object in a loop instead of creating new one each time

2010-08-20 Thread Jason Hsueh
This has come up before on the list, for instance http://groups.google.com/group/protobuf/browse_thread/thread/6f4812e30a63b88aand http://groups.google.com/group/protobuf/browse_thread/thread/368f5b0518775a9d On Fri, Aug 20, 2010 at 7:19 AM, Prakash Rao prakashrao1...@gmail.comwrote: Hi, Is it

Re: [protobuf] Re: How to retrieve parameters using tag numbers using CodedInputStream

2010-08-12 Thread Jason Hsueh
(); codedInputStream.popLimit(s1SizeEntry); int s2Size = codedInputStream.readRawVarint32(); int s2SizeEntry = codedInputStream.pushLimit(s2Size); String s2 = codedInputStream.readString(); codedInputStream.popLimit(modifiedBySizeEntry); Regards, Prakash On Aug 11, 9:17 pm, Jason Hsueh jas

Re: [protobuf] Why protobuf generates IMMUTABLEjava message?

2010-08-12 Thread Jason Hsueh
Here are some previous threads on the subject: http://groups.google.com/group/protobuf/browse_thread/thread/1699791071e92c83 http://groups.google.com/group/protobuf/browse_thread/thread/30d76b08545a0097 On Thu, Aug 12, 2010 at 9:52 AM, Peng dupeng...@gmail.com wrote: Why does protobuf generate

Re: [protobuf] Scala protocol buffers protoc plugin

2010-08-11 Thread Jason Hsueh
Added to the wiki, thanks! On Wed, Aug 11, 2010 at 12:57 AM, Jeff Plaisance jeffplaisa...@gmail.comwrote: Hello, I have written a compiler plugin that generates type safe scala wrappers for the java protoc output. It creates wrappers for each message type that use the scala Option type for

Re: [protobuf] How to retrieve parameters using tag numbers using CodedInputStream

2010-08-11 Thread Jason Hsueh
Suppose those strings are all defined as optional fields in the message. They may not be present in the serialization, so the decoder needs to read a tag to determine the field number and type before handling the value. On Wed, Aug 11, 2010 at 8:37 AM, Prakash Rao prakashrao1...@gmail.comwrote:

Re: [protobuf] Re: flushing the data

2010-08-11 Thread Jason Hsueh
ParseFromFileDescriptor will read until there is no more input. This is consistent with behavior when parsing from other types of input streams, as the message wire format is not self delimiting. For file descriptors, that means you have to reach EOF. As such, ParseFromFileDescriptor is only

Re: [protobuf] How to use SetString reflection method

2010-08-06 Thread Jason Hsueh
The setters need a (non-const) pointer to the message object. It appears fractal_handle is a reference since the getter, which takes a const reference to a message, compiles. On Fri, Aug 6, 2010 at 4:42 AM, mark.t.macdon...@googlemail.com mark.t.macdon...@googlemail.com wrote: Can you please

Re: [protobuf] Re: Java implementation questions

2010-08-05 Thread Jason Hsueh
Groups are primarily deprecated because it used to be the case that groups could not be reused in other types. Now groups can be reused, but other messages must use the length-delimited format, rather than the group format. In theory, the fact that groups do not require a length prefix makes them

Re: [protobuf] Please add j2me implementation in ThirdPartAddOns page

2010-08-03 Thread Jason Hsueh
Added to the wiki. On Thu, Jul 29, 2010 at 7:45 PM, Igor Gatis igorga...@gmail.com wrote: Here it is: http://code.google.com/p/protobuf-j2me/ -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To post to this group, send email to

Re: [protobuf] ByteString example

2010-07-30 Thread Jason Hsueh
What are you trying to do? Does the Javadoc help? http://code.google.com/apis/protocolbuffers/docs/reference/java/com/google/protobuf/ByteString.html On Fri, Jul 30, 2010 at 8:07 AM, David david.kum...@gmail.com wrote: Hi, I am a bit ashamed to ask this, but does anyone know how to use

Re: [protobuf] Gzip

2010-07-29 Thread Jason Hsueh
What exactly do you want to know about them? There are various details about how they adapt zlib to the ZeroCopy*Stream interfaces, but as a client you shouldn't need to worry about that. You can use them just like any other ZeroCopyStream. On Thu, Jul 29, 2010 at 8:58 AM, Julian González

Re: [protobuf] Gzip

2010-07-29 Thread Jason Hsueh
but first I got an error telling me zlib.h could not be found and I was also wondering if I can use GzipOutputStream along with CodedOutputStream? El 29 de julio de 2010 14:59, Jason Hsueh jas...@google.com escribió: What exactly do you want to know about them? There are various details about

Re: [protobuf] why ParseFromIstream using std::cin always returns true using a pipe?

2010-07-28 Thread Jason Hsueh
Messages without any required fields are allowed to have an empty serialization, so the library cannot assume that parsing empty input is an error. You just need to test cin.eof() separately. On Wed, Jul 28, 2010 at 7:18 AM, jetcube pmlo...@gmail.com wrote: I have a simple app that received

Re: [protobuf] Extensions in Java

2010-07-27 Thread Jason Hsueh
The C++ implementation does have a singleton registry, which allows it to magically parse extensions that are linked into the binary. This behavior can be somewhat confusing though since it relies on what the linker decides to do with generated code. The Java implementation uses an object oriented

Re: [protobuf] Building FileDescriptorSet out of FileDescriptor

2010-07-22 Thread Jason Hsueh
. On Wed, Jul 21, 2010 at 11:38 PM, Nader Salehi sal...@alumni.usc.eduwrote: If any dependency needs to be build beforehand, then how is topological ordering is supported? On 7/21/2010 17:39 Jason Hsueh writes: Ordering is important because any dependencies need to be built before

Re: [protobuf] Building FileDescriptorSet out of FileDescriptor

2010-07-21 Thread Jason Hsueh
Ordering is important because any dependencies need to be built before they are used - if you give an arbitrary order there may be errors complaining about undefined symbols or imports not being found. A depth first ordering will work, and that's exactly what protoc does when producing

Re: [protobuf] Why do field default values not get serialised?

2010-07-14 Thread Jason Hsueh
On Wed, Jul 14, 2010 at 1:47 PM, mark.t.macdon...@googlemail.com mark.t.macdon...@googlemail.com wrote: I am new and want to understand the purpose/usage of default values in the .proto file. E.g: test { optional string a 1 [default =test]; } When I create a message object and read the

Re: [protobuf] Protobuf as generic marshalling layer

2010-07-14 Thread Jason Hsueh
On Tue, Jul 13, 2010 at 1:38 AM, Galder Zamarreno market...@zamarreno.comwrote: Hi, I want to use protobuf as a generic marshalling mechanism and I'm having some issues with the unmarshalling part, because I need knowledge of what needs to be unmarshalled, i.e. in Java, access to static

Re: [protobuf] hasXXX methods

2010-07-02 Thread Jason Hsueh
See http://code.google.com/apis/protocolbuffers/docs/cpptutorial.html under the section The Protocol Buffer API On Fri, Jul 2, 2010 at 11:08 AM, jd unicom...@gmail.com wrote: Where are the hasXXX methods that are available in C++? -- You received this message because you are subscribed to

Re: [protobuf] Re: using the new plugin infrastructure

2010-06-30 Thread Jason Hsueh
Yes, you can write the plug-in in the language of your choice. On Wed, Jun 30, 2010 at 7:08 AM, qrilka qri...@gmail.com wrote: Is it possible to use other languages? E.g. python? Kind regards, Kirill Zaborsky On 2 июн, 20:25, Jason Hsueh jas...@google.com wrote: Does the test plugin

Re: [protobuf] custom protocol

2010-06-30 Thread Jason Hsueh
The library provides a standard text format (TextFormat classes in C++ and Java, text_format.py for python). If that doesn't work for you, you could write your own serializers around reflection, much like TextFormat. On Wed, Jun 30, 2010 at 7:05 AM, Vladimir Danishevsky danishev...@gmail.com

Re: [protobuf] Re: Java: Deleting from lists in protobufs

2010-06-23 Thread Jason Hsueh
On Wed, Jun 23, 2010 at 3:01 PM, Dheeraj Pandey dhee...@alumni.utexas.netwrote: Java doesn't have such a thing. Is this by design? If yes, would love to understand the rationale of why clearing-everything-and-reinserting-(N-1)-values is so much better than: (a) providing an API to do so, and

Re: [protobuf] Way to figure out the fields that are modified

2010-06-21 Thread Jason Hsueh
On Mon, Jun 21, 2010 at 8:23 AM, Ananth Arockia ananth.aroc...@gmail.comwrote: Hello, I am exploring protobuf to use it in my project. I would like to have a message defined in a .proto file. All the fields in this message would be optional due to the fact that the message producer in my

Re: [protobuf] question about SerializeToString output for cpp

2010-06-11 Thread Jason Hsueh
Yes, '\0' may appear in the binary format. output-size() will return the correct result: C++ string can store null characters without any issue. However, strlen(output-c_str()) and other calls that assume null-terminated C strings will not. On Thu, Jun 10, 2010 at 11:30 PM, mistlike

Re: [protobuf] Options extensions for dynamic messages?

2010-06-08 Thread Jason Hsueh
. Rather convoluted, but we don't have a better way. On Mon, Jun 7, 2010 at 3:25 PM, Jason Hsueh jas...@google.com wrote: Hm. Can you send the code snippet you are using to try to access your custom option? You should just be accessing the options proto from FieldDescriptor::options(), and calling

Re: [protobuf] Options extensions for dynamic messages?

2010-06-07 Thread Jason Hsueh
Hm. Can you send the code snippet you are using to try to access your custom option? You should just be accessing the options proto from FieldDescriptor::options(), and calling GetExtension() on that. Also, UnknownFields doesn't have anything to do with options extensions. Did you mean

Re: [protobuf] What is the default value for a message used as a field type within another message?

2010-06-04 Thread Jason Hsueh
No, protobuf accessors never return null. For message fields, you get the default instance of the message type. On Fri, Jun 4, 2010 at 9:32 AM, Jax jax...@gmail.com wrote: This should be pretty straightforward, but I couldn't find it in any of the documentation on default values. A slight

Re: [protobuf] Re: Questions/Ideas about Protobuf

2010-06-03 Thread Jason Hsueh
,I can only hold 10,000 pageids 4.so the server app knows it,so app just serialize 10,000 pageids into memory instead of 1,000,000 pageids. I hope I clarify it now.. If the protobuf doesn't implement it, do you have any idea about it?. On Jun 3, 12:40 am, Jason Hsueh jas...@google.com wrote

Re: [protobuf] Re: Questions/Ideas about Protobuf

2010-06-03 Thread Jason Hsueh
is based on protobuf. On the top,my app faces a lot of small stream packets in protobuf] Linkedin:http://www.linkedin.com/in/dirlt 于 2010/6/4 0:21, Jason Hsueh 写道: This really needs to be handled in the application since protobuf has no idea which fields are expendable or can be truncated

Re: [protobuf] Protoc error on Linux Mint (protoc-gen-ccp: program not found)

2010-06-02 Thread Jason Hsueh
On Wed, Jun 2, 2010 at 5:31 AM, mark.t.macdon...@googlemail.com mark.t.macdon...@googlemail.com wrote: Hi, I'm running Linux Mint, and trying to get started with protobuf-2.3.0. My install was as follows (no problems reported that I could see): ./configure --prefix=/usr make clean make

Re: [protobuf] using the new plugin infrastructure

2010-06-02 Thread Jason Hsueh
Does the test plugin help? There is a test code generator that is used in the unittest for command_line_interface.cc: http://code.google.com/p/protobuf/source/browse/trunk/src/google/protobuf/compiler/mock_code_generator.cc On Tue, Jun 1, 2010 at 4:00 AM, marcmo oliver.muel...@gmail.com wrote:

Re: [protobuf] Questions/Ideas about Protobuf

2010-06-02 Thread Jason Hsueh
On Tue, Jun 1, 2010 at 6:21 AM, bnh baoneng...@gmail.com wrote: I'm using a protobuf as the protocol for a distributed system.But now I have some questions about protobuf a.Whether protobuf provides the inteface for user-defined allocator because sometimes I find 'malloc' cost too much?

Re: [protobuf] Implementing protobuf in symbian

2010-06-01 Thread Jason Hsueh
Can you provide more details? What commands are you running, and what are your errors? In your previous thread it sounded like you were using C++, but now you mention Java - which language are you trying to use? Also, are you attempting to use the lite library or the full library? It seems most

Re: [protobuf] systesting custom utf8 validation on remote c++ node using protocol buffers from python

2010-05-17 Thread Jason Hsueh
If you compile with the macro GOOGLE_PROTOBUF_UTF8_VALIDATION_ENABLED defined, the C++ code will do UTF8 validation. However, it doesn't prevent the data from serializing or parsing, it will simply log an error message. How would you like it to fail? On Mon, May 17, 2010 at 3:15 PM, JT Olds

Re: [protobuf] Protocol buffers and large data sets

2010-05-17 Thread Jason Hsueh
There is a default byte size limit of 64MB when parsing protocol buffers - if a message is larger than that, it will fail to parse. This can be configured if you really need to parse larger messages, but it is generally not recommended. Additionally, ByteSize() returns a 32-bit integer, so there's

Re: [protobuf] Deadlock problems with protobuf static initialization in Java

2010-05-16 Thread Jason Hsueh
I think this is http://b/issue?id=2267627 On Sat, May 15, 2010 at 10:02 PM, Igor Gatis igorga...@gmail.com wrote: Agreed. So I guess I need to start looking for the deadlock in my code. Do you know any tool to help me out on that? On Sun, May 16, 2010 at 1:38 AM, Christopher Smith

Re: [protobuf] Deadlock problems with protobuf static initialization in Java

2010-05-16 Thread Jason Hsueh
Err. Got my mailing lists mixed up. I think this is due to http://bugs.sun.com/view_bug.do?bug_id=6501158 The suggested workaround has been to force initialization of your classes in main, before threads are spawned. On Sun, May 16, 2010 at 1:18 AM, Jason Hsueh jas...@google.com wrote: I think

Re: [protobuf] Detect type of message

2010-05-14 Thread Jason Hsueh
Check out the docs: http://code.google.com/apis/protocolbuffers/docs/techniques.html#union On Fri, May 14, 2010 at 12:45 PM, Vince vincedup...@gmail.com wrote: Hi, If I want to serialize many message in the same pipe, do I need one master message that includes all the others in optional

Re: [protobuf] Nested messages accessor methods

2010-05-14 Thread Jason Hsueh
Yes, you can. What is your target language? The accessor names are generated differently - in C++ you would get lower-cased names. Have you looked at the generated header? You may also want to see http://code.google.com/apis/protocolbuffers/docs/style.html On Fri, May 14, 2010 at 1:29 AM, Jacques

Re: [protobuf] Can I add a new item into an existing list of enumerations safely?

2010-05-14 Thread Jason Hsueh
Clients with the old binary will not be able to read messages containing the new enum value. This would get treated as an unknown field, meaning that the type field would not be sent in an older client. Since your field is also required, it would fail to parse. So, with this example, you would

Re: [protobuf] How to get rid of metadata only extensions dependencies

2010-05-14 Thread Jason Hsueh
No, there isn't any way to remove the dependency. The compiler doesn't try to detect why you defined an import. On Fri, May 14, 2010 at 2:38 PM, Igor Gatis igorga...@gmail.com wrote: So, let's say I'm developing a plugin which, say, add or removes builder pattern to java generator (this is

Re: [protobuf] Re: Can I add a new item into an existing list of enumerations safely?

2010-05-14 Thread Jason Hsueh
... ). So, later we have: enum Type { POP = 0, PUSH = 1, TOP = 2, TAIL = 3, UNKNOWN = 100 } and so on ... Or it really does not matter? Is this the recommended approach for this pattern? Or should I be using extends? -john On May 14, 3:15 pm, Jason Hsueh jas...@google.com wrote

Re: [protobuf] protobuf CXF RPC impl

2010-05-05 Thread Jason Hsueh
Added to the list, thanks! On Wed, May 5, 2010 at 7:46 AM, orbang gyorgy.or...@gmail.com wrote: Hi all, I've created a pluggable protobuf RPC impl based on Apache CXF: http://code.google.com/p/cxf-protobuf/ Could you please list it on the

Re: [protobuf] Seg Fault with MutableRepeatedMessage()

2010-05-04 Thread Jason Hsueh
Your msg is completely empty. There aren't any entries in the repeated field - FieldSize() should be returning 0. Your loop needs to terminate when i size, not i = size - accessing the 1st element of an empty repeated field is going to return an invalid pointer. FYI bounds checking is done in

Re: [protobuf] Avoid attributes/ Cyclic support

2010-05-04 Thread Jason Hsueh
On Mon, May 3, 2010 at 11:29 PM, Fabio Maulo fabioma...@gmail.com wrote: - Is there a way to avoid attributes ? I mean something like an internal metadata where we can define the identifier of each member. I'm not sure what you mean by this. By attributes do you mean field options? Can you

Re: [protobuf] Re: Seg Fault with MutableRepeatedMessage()

2010-05-04 Thread Jason Hsueh
a fundamental step here =) Thanks for the help! -Ryan On May 4, 12:23 pm, Jason Hsueh jas...@google.com wrote: Your msg is completely empty. There aren't any entries in the repeated field - FieldSize() should be returning 0. Your loop needs to terminate when i size, not i = size

<    1   2   3   >