Re: TPCServer and xdrlib

2008-05-20 Thread Nick Craig-Wood
Henrique Dante de Almeida [EMAIL PROTECTED] wrote: On May 19, 10:28?am, Laszlo Nagy [EMAIL PROTECTED] wrote: I cannot predict acceptable speed requirements, but I can tell that there will be some clients downloading 100MB report files from the server, so I presume that I will need a

Re: TPCServer and xdrlib

2008-05-20 Thread Laszlo Nagy
- use simple file copying from a mounted network drive Untrustable clients should not mount out anything from my server. (Also, it is not a protocol. I need to communicate with a real program, not just copying files.) - use http (web server) I mentioned this before - don't know how to

Re: TPCServer and xdrlib

2008-05-19 Thread Laszlo Nagy
It is possible to change the serialization used by Pyro http://pyro.sourceforge.net/manual/9-security.html#pickle to the the 'gnosis' XML Pickler. As I said earlier, I would not use XML. Just an example - I need to be able to transfer image files, word and excel documents. How silly it

Re: TPCServer and xdrlib

2008-05-19 Thread Laszlo Nagy
I'm trying to write a multi threaded TPC server. I have used xmlrpc How exactly did you come to the conclusion that your server must be multi threaded ? I don't think that it is important. But if you are interested: - yes, the server will probably be I/O bound, not CPU bound - I'm

Re: TPCServer and xdrlib

2008-05-19 Thread Henrique Dante de Almeida
On May 19, 10:28 am, Laszlo Nagy [EMAIL PROTECTED] wrote: I don't think that it is important. But if you are interested: - yes, the server will probably be I/O bound, not CPU bound - I'm have experience with thread programming, but not with twisted That part was just to show you that being

Re: TPCServer and xdrlib

2008-05-19 Thread Irmen de Jong
Laszlo Nagy wrote: It is possible to change the serialization used by Pyro http://pyro.sourceforge.net/manual/9-security.html#pickle to the the 'gnosis' XML Pickler. As I said earlier, I would not use XML. Just an example - I need to be able to transfer image files, word and excel

TPCServer and xdrlib

2008-05-16 Thread Laszlo Nagy
Hi All, I'm trying to write a multi threaded TPC server. I have used xmlrpc before for many purposes, but in this case this would not be efficient: - I have to send larger amounts of data, the overhead of converting to XML and parsing XML back would be too much pain - I have no clue how to

Re: TPCServer and xdrlib

2008-05-16 Thread Henrique Dante de Almeida
On May 16, 7:16 am, Laszlo Nagy [EMAIL PROTECTED] wrote:   Hi All, Hello, :-) I'm trying to write a multi threaded TPC server. I have used xmlrpc How exactly did you come to the conclusion that your server must be multi threaded ? - I have to send larger amounts of data, the overhead of

Re: TPCServer and xdrlib

2008-05-16 Thread Diez B. Roggisch
Did you consider gzipping your XML (or YAML) packets ? Would the transfer time be acceptable in this case ? That would add even more to the overhead of transcoding the transportlayer. Switching from XMLRPC to a json-based protocol reduced in a project of mine reduced the overhead 10-20fold

Re: TPCServer and xdrlib

2008-05-16 Thread Nick Craig-Wood
Laszlo Nagy [EMAIL PROTECTED] wrote: I'm trying to write a multi threaded TPC server. I have used xmlrpc before for many purposes, but in this case this would not be efficient: - I have to send larger amounts of data, the overhead of converting to XML and parsing XML back would be too

Re: TPCServer and xdrlib

2008-05-16 Thread Henrique Dante de Almeida
On May 16, 9:26 am, Diez B. Roggisch [EMAIL PROTECTED] wrote:  Did you consider gzipping your XML (or YAML) packets ? Would the transfer time be acceptable in this case ? That would add even more to the overhead of transcoding the transportlayer. Switching from XMLRPC to a json-based

Re: TPCServer and xdrlib

2008-05-16 Thread Diez B. Roggisch
Henrique Dante de Almeida schrieb: On May 16, 9:26 am, Diez B. Roggisch [EMAIL PROTECTED] wrote: Did you consider gzipping your XML (or YAML) packets ? Would the transfer time be acceptable in this case ? That would add even more to the overhead of transcoding the transportlayer. Switching