Hi Guillermo, In the company I work, we have faced a similar issue. We needed to offer a web interface to our users in order to use Globus to transfer data sets with high performance. We also tried Globus Online but although the data doesn't pass through GO, our security policy doesn't allowed used it. We also did the same questions to GO Team about a web interface to use it in our facilities.
Because all of this, we decided to build an in house solution with GridFTP. This solution is based on jGlobus API - Globus Java API ( www.globus.org/toolkit/jglobus). With this API we built a Java Web application with a database, for persistence same parameters, deployed in an application server. This tool provides a user-friendly interface with resume in case of data connection failure, TCP parallel data connection to improve the performance, scheduled transfer and integrity checking, this feature checks the file block-by-block after the transfer and re-transmits only corrupted blocks. If you have the opportunity to attend CCGrid 2013, I'll be there presenting a Poster about our solution. Best Regards. Fabio de Souza ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 14 Mar 2013 08:39:18 +1300 > From: Markus Binsteiner <[email protected]> > To: Guillermo Marco Puche <[email protected]> > Cc: [email protected] > Subject: Re: [gt-user] Globus GridFTP web interface. > Message-ID: <1363203558.3395.6.camel@think> > Content-Type: text/plain; charset="UTF-8" > > Hi Guillermo, > > the data transfer part is only a small part of what I implemented. It's > a grid-client framework called Grisu: > > https://github.com/grisu/grisu > > And its purpose is to make access to (mostly compute) grid > infrastructure easier. Since a lot of data starts up or has to end up on > the users' desktop, I needed to find a solution to get data from/to > there. http turned out to be the best solution, because that traffic is > the most likely to get through the firewall, or can at least be proxied > via a http proxy. > > Anyway, my solution uses commons-vfs, which is a virtual filesystem > library to forward-stream the data to the gridftp endpoints from the > portal. It works, but I did not spend any work on making it faster or > anything like that. There are a few more frameworks/APIs involved, happy > to explain in more detail if necessary. > > Cheers, > Markus > > On Wed, 2013-03-13 at 11:21 +0100, Guillermo Marco Puche wrote: > > Hello Markus, > > > > Could I see the solution you implemented? Did you use any API to start > > developing your frontend? > > > > Thank you. > > > > Best regards, > > Guillermo. > > > > On 03/13/2013 10:24 AM, Markus Binsteiner wrote: > > > > > Guillermo, > > > > > > I don't think there exists a webclient for GridFTP, apart from the one > > > that is part of GlobusOnline. And even with GlobusOnline you can't > > > "upload" files. They would have to use GlobusConnect, which they need > to > > > install on their desktop machine. GlobusConnect is basically a gridftp > > > server, just bundled up for easy install, without having to worry (too > > > much) about the authentication side of things. > > > > > > Once that is installed, users can kick off (and monitor) transfers from > > > the GlobusOnline website. Since that will be a 3rd party gridftp > > > transfer it'll be quite fast. But it can introduce a few problems with > > > firewalls and such, since the ports that need to be open are often (in > > > my experience anyway) closed by University/company firewalls. Your > > > mileage may vary though. > > > > > > I guess one could write a webfrontend for gridftp, where users could > > > upload files via http and then the portal would forward the files to > the > > > endpoint via gridftp. I implemented a similar solution as a SOAP > > > webservice. But it'd be quite a substantial piece of work. Even if you > > > wouldn't have to worry about how to implement the authentication part. > > > Which you probably would have to do. > > > > > > So, in short: I'd recommend you have a look at GlobusConnect and accept > > > that users need to install something on their desktop machines. > > > Everything else will be a lot of work... > > > > > > Good luck! > > > > > > Markus > > > > > > On Wed, 2013-03-13 at 09:21 +0100, Guillermo Marco Puche wrote: > > > > Hello Steve, > > > > > > > > That seems very interesting. Although I haven't tested deeply Globus > > > > Online. > > > > I'm in need to provide my users a web interface to upload big data > > > > files. I thought then that Globus could be a very good option. Since > > > > it's a tested and trusted system. > > > > But I also thought that web interface in Globus Online was available. > > > > > > > > I think what I really need is a web client for Gridftp, maybe I?m > > > > wrong. I'm a bit confused and I can't really find a tool that covers > > > > my needs. That's why I'm asking. Any guidelines or information about > > > > tools will be appreciated. > > > > > > > > Thank you very much. > > > > > > > > Best regards, > > > > Guillermo. > > > > > > > > On 03/12/2013 06:21 PM, Steve Tuecke wrote: > > > > > > > > > Globus Online is a service that we (University of Chicago) run for > the research community. It is not software that is distributed for local > operation, but rather is "software as a service". Use of Globus Online for > file transfer and synchronization is free. You can sign up through our web > site, and create your own endpoints on servers with Globus Connect > Multi-User (https://www.globusonline.org/gcmu/) and on personal computers > with Globus Connect (available on the dashboard after you login). We are > just beginning beta testing of additional features for big data sharing ( > https://www.globusonline.org/plus/) that will be available for a modest > subscription fee in order to help sustain this non-profit service. > > > > > > > > > > Regards, > > > > > -Steve > > > > > > > > > > On Mar 12, 2013, at 4:42 AM, Guillermo Marco Puche < > [email protected]> wrote: > > > > > > > > > > > Hello, > > > > > > > > > > > > I'm new to Globus. I've not been capable to install Globus yet. > > > > > > I'm interested in installing Globus to allow my users to upload > big chunks of data. > > > > > > > > > > > > I've been playing around with Globus Online and I like the web > interface. > > > > > > Is that web interface being distributed to use it? > > > > > > > > > > > > Thank you, > > > > > > > > > > > > Best regards, > > > > > > Guillermo. > > > > > > > > ------------------------------ > > _______________________________________________ > gt-user mailing list > [email protected] > https://lists.globus.org/mailman/listinfo/gt-user > > End of gt-user Digest, Vol 54, Issue 6 > ************************************** >
