Raj et al, I'm still missing something. Attached is a diagram of what I have set up - two servers interconnected with two 10GigE links. I want to pass one file, striped across both links from one server to the other, in this case from i7test4 to i7test3 and/or i7test3 to i7test4. Shown on the attachment are the three gridftp-servers I have running on each server. Are they correct? Does the command line you gave below still apply?
Hoot -----Original Message----- From: Raj Kettimuthu <[email protected]> To: Hoot Thompson <[email protected]> Subject: Re: Call Date: Thu, 9 Sep 2010 17:04:56 -0500 Hoot, Sorry for the slow response. You have to use the following command-line: $GLOBUS_LOCATION/bin/globus-url-copy -vb -stripe gsiftp://i7test3-10g1:6000/i7raid/hoot/file_12GB gsiftp://i7test3-10g2:6000/i7raid/hoot/file_12GB The data will flow between the 2 backends at each end and both the links will be used. Striping also requires that the all source backends can read the source file and all the destination backends can write to the destination file i.e, backends at each end have a shared filesystem. The tutorial slides available at http://www.globus.org/toolkit/data/gridftp/tutorials/ has more information on striping. Please post your questions to gridftp-user list so that you do not block on me. Raj On Sep 7, 2010, at 3:39 PM, Hoot Thompson wrote: > ok, I'm getting close but admittedly I've reached a point of > confusion. In trying to walk before I run, I have a triangle > configured of sort where my frontend node calls out the two NIC cards > in the other server using the -r option. > > Here's the frontend... > sudo -E /home/globus/globus/sbin/globus-gridftp-server -S -p 6000 -r > 192.168.1.13:7000,192.168.2.13:8000 -logfile /tmp/grid -log-level > 'ALL' > > On the backend I have two servers started.... > sudo -E /home/globus/globus/sbin/globus-gridftp-server -S -p 7000 -dn > -logfile /tmp/grid -log-level 'ALL' > > sudo -E /home/globus/globus/sbin/globus-gridftp-server -S -p 8000 -dn > -logfile /tmp/grid -log-level 'ALL' > > > So now when I issue the following (logged into the frontend which > is .1.12(10g1) and .2.12(10g2)) > > $GLOBUS_LOCATION/bin/globus-url-copy -vb -stripe > gsiftp://i7test3-10g1:6000/i7raid/hoot/file_12GB /i7raid/hoot/file_12GB > -----data travels over the .1.x subnet > > when I issue > $GLOBUS_LOCATION/bin/globus-url-copy -vb -stripe > gsiftp://i7test3-10g2:6000/i7raid/hoot/file_12GB /i7raid/hoot/file_12GB > ------data travels over the .2.x subnet > > I assume this makes sense. My confusion is when I bring up a second > gridftp server on the frontend, what does my globus-url-copy command > look like to pull data over both links simultanesouly? > > BTW, performance is great for the one link, > > 945.64 MB/sec avg 1179.98 MB/sec inst > > > -----Original Message----- > From: Raj Kettimuthu <[email protected]> > To: Hoot Thompson <[email protected]> > Subject: Re: Call > Date: Fri, 3 Sep 2010 16:15:24 -0500 > > You have to run 3 instances of gridftp server on each side. > > On the sending you run 2 data nodes (with -dn), one each on 1.12 and > 2.12 and run 1 control node (with -r or remote_nodes 1.12, 2.12) on > either 1.12 or 2.12 or you can designate another machine for this > > On the receiving you do the same - run 2 data nodes (with -dn), one > each on 1.13 and 2.13 and run 1 control node (with -r or remote_nodes > 1.13, 2.13) on either 1.13 or 2.13 or you can designate another > machine for this > > Then you run 'globus-url-copy -stripe <source control node> <dest > control node>' > > Hope this helps. > > Raj > On Sep 3, 2010, at 4:06 PM, Hoot Thompson wrote: > > > So on the send side I can put something like the following in > > the .conf file... > > > > remote_nodes 192.16.1.13:6000,192.168.2.13:7000 > > > > But on the receive side, how do you specify multiple data_node > > interfaces on one machine? > > > > > > Hoot > > > > > > ____________________________________________________________________ > > > > From: Raj Kettimuthu [mailto:[email protected]] > > Sent: Friday, September 03, 2010 4:39 PM > > To: Hoot Thompson > > Subject: Re: Call > > > > > > > > Hoot, > > The link below should have the information you are looking for: > > http://www.globus.org/toolkit/docs/latest-stable/data/gridftp/admin/#gridftp-admin-striped > > If something is not clear, please feel free to contact me. > > > > > > Raj > > > > On Sep 3, 2010, at 3:33 PM, Hoot Thompson wrote: > > > > > > > Maybe you'd have a moment to offer a little advice and some of > > > this will be repetitive. I currently have two servers, each with > > > two 10GigE NICs. > > > > > > i7test3 > > > 192.168.1.12 > > > 192.168.2.12 > > > > > > i7test4 > > > 192.168.1.13 > > > 192.168.2.13 > > > > > > I want to stripe a single large file over the two links. What > > > goes in the in the gridftp.conf files on both ends to make this > > > happen? Do any command line options need to be invoked when I > > > initiate the the url to url copy? > > > > > > > > > Thanks, > > > > > > hoot > > > > > > > > > __________________________________________________________________ > > > > > > From: Raj Kettimuthu [mailto:[email protected]] > > > Sent: Friday, September 03, 2010 4:12 PM > > > To: Hoot Thompson > > > Subject: Re: Call > > > > > > > > > > > > Good. I just started replying to your email on the > > > server-to-server error. Have a good long weekend. > > > > > > > > > Raj > > > > > > On Sep 3, 2010, at 3:09 PM, Hoot Thompson wrote: > > > > > > > > > > Got server to server working :-) > > > > > > > > Have a good long weekend. > > > > > > > > Hoot > > > > > > > > > > > > ________________________________________________________________ > > > > > > > > From: Raj Kettimuthu [mailto:[email protected]] > > > > Sent: Thursday, September 02, 2010 4:20 PM > > > > To: Hoot Thompson > > > > Subject: Re: Call > > > > > > > > > > > > > > > > toll-free telecon is 877-950-6599 with passcode 6356785 > > > > > > > > On Sep 2, 2010, at 3:19 PM, Hoot Thompson wrote: > > > > > > > > > > > > > Yes but I didn't get the dial in number > > > > > > > > > > -----Original Message----- > > > > > From: Raj Kettimuthu [mailto:[email protected]] > > > > > Sent: Thursday, September 02, 2010 4:16 PM > > > > > To: Hoot Thompson > > > > > Subject: Call > > > > > > > > > > Pat and I are on the call. Are you going to join? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
test_layout.pdf
Description: Adobe PDF document
