After changing rx.h and recompile debian source packages I was able to transfer 4.6 MB in 10 seconds 400KB/s. Not sure if this was mistakenly commented out diff openafs-1.4.12.1+dfsg/src/rx/rx.h ./rx.h.org 243c243 < afs_int32 maxPacketSize; /* max packet size should be per-connection since */ --- > /* afs_int32 maxPacketSize; max packet size should be per-connection > since */
=============== with rx.h changed dpkg -i openafs-fileserver_1.4.12.1+dfsg-4_amd64.deb root@web01:/afs/online# date;vos release test.vol -verbose -localauth;date Fri Feb 10 03:28:45 UTC 2012 test.vol RWrite: 536870952 ROnly: 536870953 number of sites -> 2 server mastelo partition /vicepa RW Site server web01 partition /vicepa RO Site This is a complete release of volume 536870952 Cloning RW volume 536870952 to temporary RO... done Getting status of RW volume 536870952... done Ending cloning transaction on RW volume 536870952... done Starting transaction on cloned volume 536870953... done Updating existing ro volume 536870953 on web01 ... Starting ForwardMulti from 536870953 to 536870953 on web01 (as of Sun May 31 22:41:01 2420). Deleting the releaseClone 536870953 ... done updating VLDB ... done Released volume test.vol successfully Fri Feb 10 03:29:18 UTC 2012 ======================================================================================================================= With default debian package installation root@web01:/afs/online# date;vos release test.vol -verbose -localauth;date Fri Feb 10 03:45:01 UTC 2012 test.vol RWrite: 536870952 ROnly: 536870953 number of sites -> 2 server mastelo.mdc.gameloft.org partition /vicepa RW Site server web01.tac.gameloft.org partition /vicepa RO Site This is a complete release of volume 536870952 Cloning RW volume 536870952 to temporary RO... done Getting status of RW volume 536870952... done Ending cloning transaction on RW volume 536870952... done Starting transaction on cloned volume 536870953... done Updating existing ro volume 536870953 on web01.tac.gameloft.org ... Starting ForwardMulti from 536870953 to 536870953 on web01.tac.gameloft.org (as of Sun May 31 22:51:08 2420). Deleting the releaseClone 536870953 ... done updating VLDB ... done Released volume test.vol successfully Fri Feb 10 03:45:34 UTC 2012 --- On Wed, 2/8/12, muayad y <[email protected]> wrote: From: muayad y <[email protected]> Subject: Re: [OpenAFS] replication over slower bandwidth To: "Neil Davies" <[email protected]> Cc: [email protected] Received: Wednesday, February 8, 2012, 2:28 AM Hi, with netperf/UDP tests UDP_STREAM/UDP_RR, I was able to get better idea about line speed with minimal of 400KBPS. Even after using tc and with best scenario happened, where no retransmit occured, I was able to transfer 4.6 MB in ~35 seconds. There is no disconnect between the two nodes, I have limited transfer rate/upload speed/mtu , but with no luck. I do not want to jump into a conclusion nor make judgment, but how can I fill up the pipe if rxudp does not pump much data into it? ~240 bytes/packet May be someone else can use tc netem to reproduce the problem. Thanks
