Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-03-01 Thread Andrea Righi
I know it... if I remember well this should be the first bittorrent client, in the authors of the project is reported also Bram Cohen. This should be very very similar to the client we're using (there is also the same interface and same commands available, maybe only the "backend" changes). Anyway

RE: [Sisuite-devel] Re: Bit-Torrent transport

2006-02-28 Thread Bernard Li
Title: Re: [Sisuite-devel] Re: Bit-Torrent transport Hey Andrea:   I have heard good things about BitTornado as a BT client, perhaps you can do some performance tests too with it when you get a chance:   http://www.bittornado.com/   Cheers,   Bernard From: Andrea Righi [mailto:[EMAIL

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-02-08 Thread Andrea Righi
Last changes: - splitted scripts and torrents: added the parameter AUTOINSTALL_TORRENT_DIR in /etc/systemimager/systemimager.conf to define the place where torrents resides on the image server (default: /var/lib/systemimager/torrents/) - added the function bittorrent_get_file() that performs all th

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-02-08 Thread Andrea Righi
Bernard Li wrote: >> Moreover looking at some bittorrent papers it seems that there are not >> any improvements in synchronizing the clients installation (I mean to >> synchronize the image download from all clients). So IMO there are no >> meaninful advantages integrating the bittorrent ransport

RE: [Sisuite-devel] Re: Bit-Torrent transport

2006-02-07 Thread Bernard Li
Hi Andrea: > - btget (libbt): max bandwidth 1.6MB/s, average 1.1MB/s > - BitTorrent client (freezed python scripts): max bandwidth 4.9 MB/s, > average 4.3MB/s Yeah, I don't understand why libbt performs so poorly... perhaps we should give libtorrent a shot. > Moreover looking at some bittorrent

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-02-07 Thread Andrea Righi
Hi all, I've been very busy in these last days, so my reply comes only now... Beside all, I've added some minor fixes and improvements in my bittorrent patch (attached), in particular I moved to the version 4.4.0, which seems to offer very better performances compared with the previous release. I

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-19 Thread Andrea Righi
Restructured si_installbtimage to seed more images and BOEL binaries at the same time using a single seeder on the image server... Cheers, -Andrea Index: patches/bittorrent.freezehack.patch === --- patches/bittorrent.freezehack.pat

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-18 Thread Andrea Righi
Hi all, what's new: - now also the BOEL binaries are distributed via bittorrent - modified si_installbtimage to seed both the boel binaries and the tarball of the image (using the commands launchmay-console / launchmany-curses); I'm considering to do another update, so that the si_installbtima

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-17 Thread Andrea Righi
As discussed with Bernard and Brian on IRC I've moved the python bittorrent client into the BOEL initrd. It seems to work fine. I'll have to add the code to download boel_binaries, scripts and overrides via bittorrent. Moreover the python bittorrent client has a nice command (launchmany-console

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-16 Thread Andrea Righi
Hi all, with this last pach I'd consider my bittorrent work ready to be checked into the trunk. Bernard, let me know what's your point, if you want to merge my changes in your patch, if you have comments, suggestions, etc. Otherwise I will proceed with the commit... Keep in mind that we can always

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-10 Thread Erich Focht
Hi, here are some thoughts about updating (with a test install on a 2.4GHz Xeon with RHEL4 in mind): - the full image directory requires 711MB - the tarred up image needs: 640MB - built from the image directory in 31s - compressed image tarfile: 219MB - compress time (gzi

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-10 Thread Erich Focht
Hi Bernard, I think it is very fortunate that your and Andrea's approach are different and that the implementations are done in separate parts of the code. This way we will perhaps be able to test both and compile the optimal solution out of both. In the kernel world it is quite normal to have two

RE: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-09 Thread Bernard Li
using libBT. I should be able to check my stuff in soon. Cheers, Bernard > -Original Message- > From: Andrea Righi [mailto:[EMAIL PROTECTED] > Sent: Monday, January 09, 2006 10:53 > To: [EMAIL PROTECTED] > Cc: Bernard Li; Brian Elliott Finley; [EMAIL PROTECTED]; SIS Devel >

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-09 Thread Andrea Righi
Erich Focht wrote: Hi Andrea, do you (or anybody else) mind checking this into trunk? It's easier to play with it from there and it looks already quite usable. Yes, we could check... maybe we've to synchronize with Bernard to merge both our work and we've to choose if we want to use libbt or

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-09 Thread Erich Focht
Hi Andrea, do you (or anybody else) mind checking this into trunk? It's easier to play with it from there and it looks already quite usable. Regards, Erich On Monday 09 January 2006 10:08, Andrea Righi wrote: > Hi all, > > other work for the bittorrent transport... > > In this patch I've added

RE: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-09 Thread Bernard Li
Title: Re: [Sisuite-devel] Re: Bit-Torrent transport Hey Andrea:   What speed did you get transferring between one peer to another peer?  As I have mentioned to you with my tests, I was only able to get 1.5MBytes/sec max (with --max_upload_rate 0 on a 100MBit network).   With LibBT&#

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-09 Thread Andrea Righi
Hi all, other work for the bittorrent transport... In this patch I've added to BOEL binaries the standard bittorrent python client "freezed" as a normal ELF binary, as suggested by Bernard in a previous chat with him. This is a very important issue, because with the python interpreter the B

RE: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-04 Thread Bernard Li
Title: Re: [Sisuite-devel] Re: Bit-Torrent transport Steve mentioned using "ar" in place of tar so that we can update the archive - anybody have experience with this?   Cheers,   Bernard From: [EMAIL PROTECTED] on behalf of Bernard LiSent: Mon 02/01/2006 15:46To: Paul

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-03 Thread Andrea Righi
A new patch that fixes some monitoring errors using bittorrent... Regards, -Andrea diff -urN trunk/etc/autoinstallscript.template bittorrent/etc/autoinstallscript.template --- trunk/etc/autoinstallscript.template 2006-01-02 09:40:53.0 +0100 +++ bittorrent/etc/autoinstallscript.template 20

RE: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-02 Thread Bernard Li
Title: Re: [Sisuite-devel] Re: Bit-Torrent transport Well this would be tricky because right now we are creating a tarball of the image directory, as far as "update-clients" is concerned we are re-deploying as there are no previous information about the image. (you need to re-

Re: [Sisuite-devel] Re: Bit-Torrent transport

2006-01-02 Thread Paul Greidanus
Hi Andrea and Bernard, I'm just wondering if there is (or is planned) to have a way to use BT to run si_updateclient? or is this for initial deployment only? I've always thought systemimager's strongest feature is the update client feature, but I've had trouble if I tell a large number (>50) m

[Sisuite-devel] Re: Bit-Torrent transport

2006-01-02 Thread Andrea Righi
Hi all, attached is some work I've done regarding bittorrent... Since this seems to work and since it can be useful also for those that are working for the bittorrent porting (in particular for Bernard) I've decided to post this patch (based on the developer trunk). I've used the standard bt

[Sisuite-devel] RE: Bit-Torrent transport

2005-12-31 Thread Bernard Li
Title: Re: Bit-Torrent transport Any suggestions on how we can keep the tarball size small (so that it fits in tmpfs)?   Right now I can't test at home since my nodes only have ~ 384MB memory.  It is stretching it even if I gzip the tar file.   The only other alternative is to break the l

[Sisuite-devel] Re: Bit-Torrent transport

2005-12-31 Thread Brian Elliott Finley
Thus spake Bernard Li ([EMAIL PROTECTED]): Hi Andrea: I think it is possible to compile python code such that you can execute it without the python interpreter - if you want, you can probably take a look into that route, however it seems that libBT is working fine. In fact I wouldn't mind in

[Sisuite-devel] Re: Bit-Torrent transport

2005-12-31 Thread Brian Elliott Finley
Thus spake Bernard Li ([EMAIL PROTECTED]): Hey guys: Just did some more test with the latest BitTorrent (4.2.2) downloaded from Dag's site: http://dag.wieers.com/packages/bittorrent/ If you want to bt an image, you'll have to exclude the /dev dir for sure. Also, as Erich pointed out, the fi