Hi Guillermo,

the data transfer part is only a small part of what I implemented. It's
a grid-client framework called Grisu:

https://github.com/grisu/grisu

And its purpose is to make access to (mostly compute) grid
infrastructure easier. Since a lot of data starts up or has to end up on
the users' desktop, I needed to find a solution to get data from/to
there. http turned out to be the best solution, because that traffic is
the most likely to get through the firewall, or can at least be proxied
via a http proxy.

Anyway, my solution uses commons-vfs, which is a virtual filesystem
library to forward-stream the data to the gridftp endpoints from the
portal. It works, but I did not spend any work on making it faster or
anything like that. There are a few more frameworks/APIs involved, happy
to explain in more detail if necessary.

Cheers,
Markus

On Wed, 2013-03-13 at 11:21 +0100, Guillermo Marco Puche wrote:
> Hello Markus,
> 
> Could I see the solution you implemented? Did you use any API to start
> developing your frontend?
> 
> Thank you.
> 
> Best regards,
> Guillermo.
> 
> On 03/13/2013 10:24 AM, Markus Binsteiner wrote:
> 
> > Guillermo,
> > 
> > I don't think there exists a webclient for GridFTP, apart from the one
> > that is part of GlobusOnline. And even with GlobusOnline you can't
> > "upload" files. They would have to use GlobusConnect, which they need to
> > install on their desktop machine. GlobusConnect is basically a gridftp
> > server, just bundled up for easy install, without having to worry (too
> > much) about the authentication side of things.
> > 
> > Once that is installed, users can kick off (and monitor) transfers from
> > the GlobusOnline website. Since that will be a 3rd party gridftp
> > transfer it'll be quite fast. But it can introduce a few problems with
> > firewalls and such, since the ports that need to be open are often (in
> > my experience anyway) closed by University/company firewalls. Your
> > mileage may vary though.
> > 
> > I guess one could write a webfrontend for gridftp, where users could
> > upload files via http and then the portal would forward the files to the
> > endpoint via gridftp. I implemented a similar solution as a SOAP
> > webservice. But it'd be quite a substantial piece of work. Even if you
> > wouldn't have to worry about how to implement the authentication part.
> > Which you probably would have to do.
> > 
> > So, in short: I'd recommend you have a look at GlobusConnect and accept
> > that users need to install something on their desktop machines.
> > Everything else will be a lot of work...
> > 
> > Good luck!
> > 
> > Markus
> > 
> > On Wed, 2013-03-13 at 09:21 +0100, Guillermo Marco Puche wrote:
> > > Hello Steve,
> > > 
> > > That seems very interesting. Although I haven't tested deeply Globus
> > > Online.
> > > I'm in need to provide my users a web interface to upload big data
> > > files. I thought then that Globus could be a very good option. Since
> > > it's a tested and trusted system. 
> > > But I also thought that web interface in Globus Online was available.
> > > 
> > > I think what I really need is a web client for Gridftp, maybe I’m
> > > wrong. I'm a bit confused and I can't really find a tool that covers
> > > my needs. That's why I'm asking. Any guidelines or information about
> > > tools will be appreciated.
> > > 
> > > Thank you very much.
> > > 
> > > Best regards,
> > > Guillermo.
> > > 
> > > On 03/12/2013 06:21 PM, Steve Tuecke wrote:
> > > 
> > > > Globus Online is a service that we (University of Chicago) run for the 
> > > > research community. It is not software that is distributed for local 
> > > > operation, but rather is "software as a service". Use of Globus Online 
> > > > for file transfer and synchronization is free. You can sign up through 
> > > > our web site, and create your own endpoints on servers with Globus 
> > > > Connect Multi-User (https://www.globusonline.org/gcmu/) and on personal 
> > > > computers with Globus Connect (available on the dashboard after you 
> > > > login). We are just beginning beta testing of additional features for 
> > > > big data sharing (https://www.globusonline.org/plus/) that will be 
> > > > available for a modest subscription fee in order to help sustain this 
> > > > non-profit service.
> > > > 
> > > > Regards,
> > > > -Steve
> > > > 
> > > > On Mar 12, 2013, at 4:42 AM, Guillermo Marco Puche 
> > > > <[email protected]> wrote:
> > > > 
> > > > > Hello,
> > > > > 
> > > > > I'm new to Globus. I've not been capable to install Globus yet.
> > > > > I'm interested in installing Globus to allow my users to upload big 
> > > > > chunks of data.
> > > > > 
> > > > > I've been playing around with Globus Online and I like the web 
> > > > > interface.
> > > > > Is that web interface being distributed to use it?
> > > > > 
> > > > > Thank you,
> > > > > 
> > > > > Best regards,
> > > > > Guillermo.
> > 


Reply via email to