[protobuf] ANN: ProtoStream - A NodeJS module to emit ProtoBuf messages from a stream, SAX-style.
This module uses ProtocolBuffers to de-frame protocol buffer messages within a (TCP) stream. https://github.com/chrisdew/protostream Hope it's useful to others too, Chris. -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+unsubscr...@googlegroups.com. To post to this group, send email to protobuf@googlegroups.com. Visit this group at http://groups.google.com/group/protobuf. For more options, visit https://groups.google.com/d/optout.
[protobuf] Where is the (meta) .proto file which describes .desc files?
Hi, Where is the (meta) .proto file which describes .desc files? I make .desc files with: protoc --descriptor_set_out=foo.desc --include_imports foo.proto. Am I correct in believing that the .desc files are in protobuf format? If so, where can I get the .proto file which describes their format? Thanks, Chris. P.S. Cross posted to http://stackoverflow.com/questions/18636887/where-is-the-meta-proto-file-which-describes-desc-files -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+unsubscr...@googlegroups.com. To post to this group, send email to protobuf@googlegroups.com. Visit this group at http://groups.google.com/group/protobuf. For more options, visit https://groups.google.com/groups/opt_out.
Re: [protobuf] Where is the (meta) .proto file which describes .desc files?
Hi Oliver, That work perfectly. If you're a stackoverflow user, I'll accept your answer if you paste it there. Thanks, Chris. On Thursday, 5 September 2013 14:09:10 UTC+1, Oliver wrote: On Thu, Sep 5, 2013 at 1:52 PM, Chris Dew cms...@gmail.com javascript:wrote: Where is the (meta) .proto file which describes .desc files? I make .desc files with: protoc --descriptor_set_out=foo.desc --include_imports foo.proto. https://code.google.com/p/protobuf/source/browse/trunk/src/google/protobuf/descriptor.proto Look for FileDescriptorSet. Oliver -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+unsubscr...@googlegroups.com. To post to this group, send email to protobuf@googlegroups.com. Visit this group at http://groups.google.com/group/protobuf. For more options, visit https://groups.google.com/groups/opt_out.
[protobuf] Tool to generate MySQL/SQLite schemas from .proto files.
Hi, I'm looking for a toll which will generate MySQL/SQLite schemas from .proto files. http://stackoverflow.com/questions/18082871/im-looking-for-a-tool-which-processes-proto-files-into-mysql-sqlite-schemas Thanks, Chris. -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+unsubscr...@googlegroups.com. To post to this group, send email to protobuf@googlegroups.com. Visit this group at http://groups.google.com/group/protobuf. For more options, visit https://groups.google.com/groups/opt_out.
Re: [protobuf] Digest for protobuf@googlegroups.com - 11 Messages in 7 Topics
Hi, I'm looking for a toll which will generate MySQL/SQLite schemas from .proto files. http://stackoverflow.com/questions/18082871/im-looking-for-a-tool-which-processes-proto-files-into-mysql-sqlite-schemas Thanks, Chris. On 6 August 2013 13:42, protobuf@googlegroups.com wrote: Today's Topic Summary Group: http://groups.google.com/group/protobuf/topics - Issue 541 in protobuf: Double decode in google.protobuf.text_format._CUnescape#14053a61a6c9c0b2_group_thread_0[1 Update] - ByteString using N bytes from an InputStream?#14053a61a6c9c0b2_group_thread_1[4 Updates] - protobuf mingw error #14053a61a6c9c0b2_group_thread_2 [1 Update] - Question about size/speed of protobufs with different formats#14053a61a6c9c0b2_group_thread_3[2 Updates] - Using Options #14053a61a6c9c0b2_group_thread_4 [1 Update] - Protocol Buffers Specification and the syntax keyword.#14053a61a6c9c0b2_group_thread_5[1 Update] - Issue 540 in protobuf: Add protoc-gen-haxe to ThirdPartyAddOns wiki page, please #14053a61a6c9c0b2_group_thread_6 [1 Update] Issue 541 in protobuf: Double decode in google.protobuf.text_format._CUnescapehttp://groups.google.com/group/protobuf/t/86c0c99e91cd1958 proto...@googlecode.com Aug 06 10:53AM Status: New Owner: Labels: Type-Defect Priority-Medium New issue 541 by matt.k...@undue.org: Double decode in google.protobuf.text_format._CUnescape http://code.google.com/p/protobuf/issues/detail?id=541 What steps will reproduce the problem? print google.protobuf.text_format._CUnescape('\\x5c') Traceback (most recent call last): File stdin, line 1, in module File /usr/lib/python2.7/dist-packages/google/protobuf/text_format.py, line 691, in _CUnescape return result.decode('string_escape') ValueError: Trailing \ in string What is the expected output? What do you see instead? The expected output is a single backslash. _CUnescape works if the input is instead given in octal: print google.protobuf.text_format._CUnescape('\\134') \ When the input is given in hex the escaped backslash is unescaped _twice_, once in the re.sub() and once in the str.decode(). I'm not using the trunk HEAD but I can see that the issue is still present. -- You received this message because this project is configured to send all issue notifications to this address. You may adjust your notification preferences at: https://code.google.com/hosting/settings ByteString using N bytes from an InputStream?http://groups.google.com/group/protobuf/t/1903436bc567615e V.B. vidalborro...@gmail.com Aug 05 03:23PM -0700 Greetings all, We are using version 2.5. What is the most efficient way (*i.e.* single copy operation, no extra byte arrays) to construct a ByteString from a specific number of bytes in an InputStream? The various versions of ByteString.readFrom() drain the stream completely, which is not what we need; any data past *N* bytes should remain in the stream. The ByteString.readChunk() method looks like it will work if we simply give it * N* as the chunkSize parameter. Unfortunately, ByteString.readChunk() is declared private, so that method is not currently an option. Is there another option that I just haven't found in the source code yet? (Thanks for taking the time to read this question.) Feng Xiao xiaof...@google.com Aug 05 04:32PM -0700 ByteString.readChunk() method looks like it will work if we simply give it *N* as the chunkSize parameter. Unfortunately, ByteString.readChunk()is declared private, so that method is not currently an option. Is there another option that I just haven't found in the source code yet? How about create an wrapper InputStream that only reads N bytes from the original InputStream and provide the wrapper to BytesString.readFrom()? V.B. vidalborro...@gmail.com Aug 05 09:28PM -0700 Hi Feng Xiao! Thanks for the response. That's actually our backup plan. We were hoping to avoid it, though, since the wrappers would each contain an extra copy of the data internally. Our ideal case is for the data to get copied in a single step directly from an InputStream to a ByteString with no intermediate copies along the way. Question: You would know best... Would the safety of ByteStrings be preserved if the readChunk() method were to be made public? If so, I'll open a feature request on the issue tracker. On Monday, August 5, 2013 7:32:49 PM UTC-4, Feng Xiao wrote: V.B. vidalborro...@gmail.com Aug 05 09:31PM -0700 ... Actually, I just now took a closer look at the readChunk() method. Even that method makes an internal copy, so it looks like readChunk() isn't what we are looking for after all. Hmmm. On Tuesday, August
Re: [protobuf] protobuf == SQL
I would use: protoc --descriptor_set_out=foo.desc --include_imports foo.proto to generate a description of the protocol in protobuf format. Then I would transform every message type into a table. If you want more information, email me at cms...@gmail.com All the best, Chris. On Wednesday, 21 April 2010 19:53:03 UTC+1, ury wrote: Hi, I wonder if someone has an idea for a generic way of storing protobuf messages in an SQL database (not as a blob, but in a way the data can be queried with SQL statements) and how to construct the protobuf messages back from the SQL database. Thank you -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To post to this group, send email to protobuf@googlegroups.com. To unsubscribe from this group, send email to protobuf+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/protobuf?hl=en. -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To view this discussion on the web visit https://groups.google.com/d/msg/protobuf/-/i1ltQF6YWGIJ. To post to this group, send email to protobuf@googlegroups.com. To unsubscribe from this group, send email to protobuf+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/protobuf?hl=en.
[protobuf] How do you use extensions across multiple .proto files?
How do you use extensions across multiple .proto files? http://code.google.com/apis/protocolbuffers/docs/proto.html#extensions see line: // This can even be in a different file. I've tried: protoc -I=./ --java_out=./ ./wrapper.proto ./attach.proto but get the error: attach.proto:6:8: Wrapper is not defined. I feel I need some form of #include, but have not seen any documentation for this. Thanks, Chris. wrapper.proto: package pbtest; option java_package = pbtest; option java_outer_classname = WrapperProtos; message Wrapper { required string address = 1; optional sfixed64 timestamp = 2; required int64 sequence = 3; optional bool ack_not_required = 4; extensions 7 to 100; } attach.proto: package pbtest; option java_package = pbtest; option java_outer_classname = WrapperProtos; extend Wrapper { optional Attach attach = 8; } message Attach { required sfixed32 pv = 1; required sfixed32 attempt = 2; } -- You received this message because you are subscribed to the Google Groups Protocol Buffers group. To post to this group, send email to protobuf@googlegroups.com. To unsubscribe from this group, send email to protobuf+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/protobuf?hl=en.