Thanks Chris and Cameron, I'll give it a try - off course, that is we decide to use push-pull for the SKA project, Chris. I appreciate both of you guys' help, Luca
On Feb 29, 2012, at 9:03 AM, Mattmann, Chris A (388J) wrote: > Hey Guys, > > Just wanted to loop in on this. Yes, push pull does support download > of full directory trees. Probably the best guide to check out is Brian's > documentation on the DirFileStructXML here: > > http://s.apache.org/yz > > I also wrote a static user guide here: > > http://s.apache.org/10Z > > One thing to note too is that some of the plugins for Push Pull that > have been develop use non ALv2 compatible code, so if you want > those plugins for now (until someone writes nice shiny new ALv2 > compatible versions which I would LOVE), you can find them here > at Apache Extras: > > http://code.google.com/a/apache-extras.org/p/oodt-pushpull-plugins/ > > That you can cull information from. If you have any further specific > questions I can help. > > Thanks! > > Cheers, > Chris > > On Feb 28, 2012, at 7:40 AM, Cameron Goodale wrote: > >> Luca, >> >> I haven't tried this exact use case within Crawler, but Crawler does >> support scp and I have used 'scp -r' to recursively download a folder and >> all content housed within. I can only imagine ftp has a similar recursive >> option as well. >> >> Maybe another more Crawler Savy dev can shine some light on the recursion >> use case when using Crawler. >> >> -Cameron >> >> P.S. When we get a final answer let's add this to the Crawler User Guide >> Wiki too as an example use case. Glad you found the Crawler Wiki page >> useful. >> >> On Tue, Feb 28, 2012 at 7:01 AM, Cinquini, Luca (3880) < >> luca.cinqu...@jpl.nasa.gov> wrote: >> >>> Hi all, >>> I have a quick question concerning the pushpull framework : is >>> there any way to transfer full directory trees, as opposed to single files >>> ? And which of the currently implemented transfer protocols would allow >>> that ? I haven't see any examples on that, though I might have missed it. >>> >>> thanks a lot, >>> Luca >>> >>> P.S.: Cameron, thanks for writing the push-pull user guide - it's great. >>> >>> >> >> >> -- >> >> Sent from a Tin Can attached to a String > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: chris.a.mattm...@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >
