Have you profiled this program? I would be surprised if protobuf code consumes a significant amount of time: all you are doing is setting the field values.
If you want to minimize memory usage, you can probably flush your LogFile periodically to the stream: as long as you don't write anything else to the stream, the concatenated data will be properly parsed into a single message with all the LogRecords. On Tue, Apr 10, 2012 at 5:51 PM, Shrijeet Paliwal < [email protected]> wrote: > Can one of more experienced members comment on this attempt > https://gist.github.com/2355991 > It took 25 seconds to convert a 261M file using this. The heap usage > was > 512M > I am hoping for tips to improve performance. > > On Apr 6, 3:14 pm, Shrijeet Paliwal <[email protected]> > wrote: > > Could some one me direct on how to parse and map a delimited string to > > a protobuf Message, example a tab delimited string with 100 fields > > needs to be mapped to respective protobuf defined message. I am trying > > to convert a text log file to a protobuf serialized file. > > > > -Shrijeet > > -- > You received this message because you are subscribed to the Google Groups > "Protocol Buffers" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/protobuf?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Protocol Buffers" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/protobuf?hl=en.
