[protobuf] ANN: ProtoStream - A NodeJS module to emit ProtoBuf messages from a stream, SAX-style.

2014-11-05 Thread Chris Dew
This module uses ProtocolBuffers to de-frame protocol buffer messages 
within a (TCP) stream. 

https://github.com/chrisdew/protostream

Hope it's useful to others too,

Chris.

-- 
You received this message because you are subscribed to the Google Groups 
Protocol Buffers group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to protobuf+unsubscr...@googlegroups.com.
To post to this group, send email to protobuf@googlegroups.com.
Visit this group at http://groups.google.com/group/protobuf.
For more options, visit https://groups.google.com/d/optout.


[protobuf] Where is the (meta) .proto file which describes .desc files?

2013-09-05 Thread Chris Dew
Hi,

Where is the (meta) .proto file which describes .desc files?

I make .desc files with: protoc --descriptor_set_out=foo.desc 
--include_imports foo.proto.

Am I correct in believing that the .desc files are in protobuf format?

If so, where can I get the .proto file which describes their format?

Thanks,

Chris.

P.S. Cross posted to 
http://stackoverflow.com/questions/18636887/where-is-the-meta-proto-file-which-describes-desc-files

-- 
You received this message because you are subscribed to the Google Groups 
Protocol Buffers group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to protobuf+unsubscr...@googlegroups.com.
To post to this group, send email to protobuf@googlegroups.com.
Visit this group at http://groups.google.com/group/protobuf.
For more options, visit https://groups.google.com/groups/opt_out.


Re: [protobuf] Where is the (meta) .proto file which describes .desc files?

2013-09-05 Thread Chris Dew
Hi Oliver,

That work perfectly.  If you're a stackoverflow user, I'll accept your 
answer if you paste it there.

Thanks,

Chris. 

On Thursday, 5 September 2013 14:09:10 UTC+1, Oliver wrote:

 On Thu, Sep 5, 2013 at 1:52 PM, Chris Dew cms...@gmail.com 
 javascript:wrote:

 Where is the (meta) .proto file which describes .desc files?


 I make .desc files with: protoc --descriptor_set_out=foo.desc 
 --include_imports foo.proto.



 https://code.google.com/p/protobuf/source/browse/trunk/src/google/protobuf/descriptor.proto

 Look for FileDescriptorSet.

 Oliver



-- 
You received this message because you are subscribed to the Google Groups 
Protocol Buffers group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to protobuf+unsubscr...@googlegroups.com.
To post to this group, send email to protobuf@googlegroups.com.
Visit this group at http://groups.google.com/group/protobuf.
For more options, visit https://groups.google.com/groups/opt_out.


[protobuf] Tool to generate MySQL/SQLite schemas from .proto files.

2013-08-07 Thread Chris Dew
Hi,

I'm looking for a toll which will generate MySQL/SQLite schemas from .proto 
files.

http://stackoverflow.com/questions/18082871/im-looking-for-a-tool-which-processes-proto-files-into-mysql-sqlite-schemas

Thanks,

Chris.

-- 
You received this message because you are subscribed to the Google Groups 
Protocol Buffers group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to protobuf+unsubscr...@googlegroups.com.
To post to this group, send email to protobuf@googlegroups.com.
Visit this group at http://groups.google.com/group/protobuf.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [protobuf] Digest for protobuf@googlegroups.com - 11 Messages in 7 Topics

2013-08-06 Thread Chris Dew
Hi,

I'm looking for a toll which will generate MySQL/SQLite schemas from .proto
files.

http://stackoverflow.com/questions/18082871/im-looking-for-a-tool-which-processes-proto-files-into-mysql-sqlite-schemas

Thanks,

Chris.


On 6 August 2013 13:42, protobuf@googlegroups.com wrote:

   Today's Topic Summary

 Group: http://groups.google.com/group/protobuf/topics

- Issue 541 in protobuf: Double decode in
google.protobuf.text_format._CUnescape#14053a61a6c9c0b2_group_thread_0[1 
 Update]
- ByteString using N bytes from an 
 InputStream?#14053a61a6c9c0b2_group_thread_1[4 Updates]
- protobuf mingw error #14053a61a6c9c0b2_group_thread_2 [1 Update]
- Question about size/speed of protobufs with different 
 formats#14053a61a6c9c0b2_group_thread_3[2 Updates]
- Using Options #14053a61a6c9c0b2_group_thread_4 [1 Update]
- Protocol Buffers Specification and the syntax 
 keyword.#14053a61a6c9c0b2_group_thread_5[1 Update]
- Issue 540 in protobuf: Add protoc-gen-haxe to ThirdPartyAddOns wiki
page, please #14053a61a6c9c0b2_group_thread_6 [1 Update]

   Issue 541 in protobuf: Double decode in
 google.protobuf.text_format._CUnescapehttp://groups.google.com/group/protobuf/t/86c0c99e91cd1958

proto...@googlecode.com Aug 06 10:53AM

Status: New
Owner: 
Labels: Type-Defect Priority-Medium

New issue 541 by matt.k...@undue.org: Double decode in
google.protobuf.text_format._CUnescape
http://code.google.com/p/protobuf/issues/detail?id=541

What steps will reproduce the problem?

 print google.protobuf.text_format._CUnescape('\\x5c')
Traceback (most recent call last):
File stdin, line 1, in module
File
/usr/lib/python2.7/dist-packages/google/protobuf/text_format.py,
line 691, in _CUnescape
return result.decode('string_escape')
ValueError: Trailing \ in string

What is the expected output? What do you see instead?

The expected output is a single backslash. _CUnescape works if the
input
is instead given in octal:

 print google.protobuf.text_format._CUnescape('\\134')
\

When the input is given in hex the escaped backslash is unescaped
_twice_,
once in the re.sub() and once in the str.decode().

I'm not using the trunk HEAD but I can see that the issue is still
present.

--
You received this message because this project is configured to send
all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings



   ByteString using N bytes from an 
 InputStream?http://groups.google.com/group/protobuf/t/1903436bc567615e

V.B. vidalborro...@gmail.com Aug 05 03:23PM -0700

Greetings all,
We are using version 2.5. What is the most efficient way (*i.e.*
single
copy operation, no extra byte arrays) to construct a ByteString from a
specific number of bytes in an InputStream? The various versions of
ByteString.readFrom() drain the stream completely, which is not what
we
need; any data past *N* bytes should remain in the stream. The
ByteString.readChunk() method looks like it will work if we simply
give it *
N* as the chunkSize parameter. Unfortunately, ByteString.readChunk()
is
declared private, so that method is not currently an option. Is there
another option that I just haven't found in the source code yet?

(Thanks for taking the time to read this question.)




Feng Xiao xiaof...@google.com Aug 05 04:32PM -0700

 ByteString.readChunk() method looks like it will work if we simply
give
 it *N* as the chunkSize parameter. Unfortunately,
ByteString.readChunk()is declared private, so that method is not currently
an option. Is there
 another option that I just haven't found in the source code yet?

How about create an wrapper InputStream that only reads N bytes from
the
original InputStream and provide the wrapper to BytesString.readFrom()?






V.B. vidalborro...@gmail.com Aug 05 09:28PM -0700

Hi Feng Xiao! Thanks for the response.
That's actually our backup plan. We were hoping to avoid it, though,
since the wrappers would each contain an extra copy of the data
internally.
Our ideal case is for the data to get copied in a single step directly
from
an InputStream to a ByteString with no intermediate copies along the
way.
Question: You would know best... Would the safety of ByteStrings be
preserved if the readChunk() method were to be made public? If so,
I'll
open a feature request on the issue tracker.

On Monday, August 5, 2013 7:32:49 PM UTC-4, Feng Xiao wrote:




V.B. vidalborro...@gmail.com Aug 05 09:31PM -0700

... Actually, I just now took a closer look at the readChunk() method.
Even
that method makes an internal copy, so it looks like readChunk() isn't
what
we are looking for after all. Hmmm.

On Tuesday, August 

Re: [protobuf] protobuf == SQL

2012-05-23 Thread Chris Dew
I would use:

protoc --descriptor_set_out=foo.desc --include_imports foo.proto

to generate a description of the protocol in protobuf format.

Then I would transform every message type into a table.

If you want more information, email me at cms...@gmail.com

All the best,

Chris.

On Wednesday, 21 April 2010 19:53:03 UTC+1, ury wrote:

 Hi, 

 I wonder if someone has an idea for a generic way of storing protobuf 
 messages in an SQL database (not as a blob, but in a way the data can 
 be queried with SQL statements) and how to construct the protobuf 
 messages back from the SQL database. 

 Thank you 

 -- 
 You received this message because you are subscribed to the Google Groups 
 Protocol Buffers group. 
 To post to this group, send email to protobuf@googlegroups.com. 
 To unsubscribe from this group, send email to 
 protobuf+unsubscr...@googlegroups.com. 
 For more options, visit this group at 
 http://groups.google.com/group/protobuf?hl=en. 



-- 
You received this message because you are subscribed to the Google Groups 
Protocol Buffers group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/protobuf/-/i1ltQF6YWGIJ.
To post to this group, send email to protobuf@googlegroups.com.
To unsubscribe from this group, send email to 
protobuf+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/protobuf?hl=en.



[protobuf] How do you use extensions across multiple .proto files?

2012-01-05 Thread Chris Dew
How do you use extensions across multiple .proto files?

http://code.google.com/apis/protocolbuffers/docs/proto.html#extensions

see line:  // This can even be in a different file.

I've tried:
protoc -I=./ --java_out=./ ./wrapper.proto ./attach.proto

but get the error: attach.proto:6:8:
Wrapper is not defined.

I feel I need some form of #include, but have not seen any
documentation for this.

Thanks,

Chris.


wrapper.proto:

package pbtest;

option java_package = pbtest;
option java_outer_classname = WrapperProtos;

message Wrapper {
  required string address = 1;
  optional sfixed64 timestamp = 2;
  required int64 sequence = 3;
  optional bool ack_not_required = 4;
  extensions 7 to 100;
}


attach.proto:

package pbtest;

option java_package = pbtest;
option java_outer_classname = WrapperProtos;

extend Wrapper {
  optional Attach attach = 8;
}

message Attach {
  required sfixed32 pv = 1;
  required sfixed32 attempt = 2;
}

-- 
You received this message because you are subscribed to the Google Groups 
Protocol Buffers group.
To post to this group, send email to protobuf@googlegroups.com.
To unsubscribe from this group, send email to 
protobuf+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/protobuf?hl=en.