Hi Fábio, this sounds interesting. Do you plan to open source that after CCGrid? Or is it already? I'd love to have a peek...
Cheers, Markus On Thu, 2013-03-14 at 17:05 -0300, Fábio Moreira wrote: > Hi Guillermo, > > > In the company I work, we have faced a similar issue. We needed to > offer a web interface to our users in order to use Globus to transfer > data sets with high performance. We also tried Globus Online but > although the data doesn't pass through GO, our security policy doesn't > allowed used it. We also did the same questions to GO Team about a web > interface to use it in our facilities. > > > Because all of this, we decided to build an in house solution with > GridFTP. This solution is based on jGlobus API - Globus Java API > (www.globus.org/toolkit/jglobus). With this API we built a Java Web > application with a database, for persistence same parameters, > deployed in an application server. This tool provides a user-friendly > interface with resume in case of data connection failure, TCP parallel > data connection to improve the performance, scheduled transfer and > integrity checking, this feature checks the file block-by-block after > the transfer and re-transmits only corrupted blocks. > > > If you have the opportunity to attend CCGrid 2013, I'll be there > presenting a Poster about our solution. > > > Best Regards. > > > Fabio de Souza > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 14 Mar 2013 08:39:18 +1300 > From: Markus Binsteiner <[email protected]> > To: Guillermo Marco Puche > <[email protected]> > Cc: [email protected] > Subject: Re: [gt-user] Globus GridFTP web interface. > Message-ID: <1363203558.3395.6.camel@think> > Content-Type: text/plain; charset="UTF-8" > > Hi Guillermo, > > the data transfer part is only a small part of what I > implemented. It's > a grid-client framework called Grisu: > > https://github.com/grisu/grisu > > And its purpose is to make access to (mostly compute) grid > infrastructure easier. Since a lot of data starts up or has to > end up on > the users' desktop, I needed to find a solution to get data > from/to > there. http turned out to be the best solution, because that > traffic is > the most likely to get through the firewall, or can at least > be proxied > via a http proxy. > > Anyway, my solution uses commons-vfs, which is a virtual > filesystem > library to forward-stream the data to the gridftp endpoints > from the > portal. It works, but I did not spend any work on making it > faster or > anything like that. There are a few more frameworks/APIs > involved, happy > to explain in more detail if necessary. > > Cheers, > Markus > > On Wed, 2013-03-13 at 11:21 +0100, Guillermo Marco Puche > wrote: > > Hello Markus, > > > > Could I see the solution you implemented? Did you use any > API to start > > developing your frontend? > > > > Thank you. > > > > Best regards, > > Guillermo. > > > > On 03/13/2013 10:24 AM, Markus Binsteiner wrote: > > > > > Guillermo, > > > > > > I don't think there exists a webclient for GridFTP, apart > from the one > > > that is part of GlobusOnline. And even with GlobusOnline > you can't > > > "upload" files. They would have to use GlobusConnect, > which they need to > > > install on their desktop machine. GlobusConnect is > basically a gridftp > > > server, just bundled up for easy install, without having > to worry (too > > > much) about the authentication side of things. > > > > > > Once that is installed, users can kick off (and monitor) > transfers from > > > the GlobusOnline website. Since that will be a 3rd party > gridftp > > > transfer it'll be quite fast. But it can introduce a few > problems with > > > firewalls and such, since the ports that need to be open > are often (in > > > my experience anyway) closed by University/company > firewalls. Your > > > mileage may vary though. > > > > > > I guess one could write a webfrontend for gridftp, where > users could > > > upload files via http and then the portal would forward > the files to the > > > endpoint via gridftp. I implemented a similar solution as > a SOAP > > > webservice. But it'd be quite a substantial piece of work. > Even if you > > > wouldn't have to worry about how to implement the > authentication part. > > > Which you probably would have to do. > > > > > > So, in short: I'd recommend you have a look at > GlobusConnect and accept > > > that users need to install something on their desktop > machines. > > > Everything else will be a lot of work... > > > > > > Good luck! > > > > > > Markus > > > > > > On Wed, 2013-03-13 at 09:21 +0100, Guillermo Marco Puche > wrote: > > > > Hello Steve, > > > > > > > > That seems very interesting. Although I haven't tested > deeply Globus > > > > Online. > > > > I'm in need to provide my users a web interface to > upload big data > > > > files. I thought then that Globus could be a very good > option. Since > > > > it's a tested and trusted system. > > > > But I also thought that web interface in Globus Online > was available. > > > > > > > > I think what I really need is a web client for Gridftp, > maybe I?m > > > > wrong. I'm a bit confused and I can't really find a tool > that covers > > > > my needs. That's why I'm asking. Any guidelines or > information about > > > > tools will be appreciated. > > > > > > > > Thank you very much. > > > > > > > > Best regards, > > > > Guillermo. > > > > > > > > On 03/12/2013 06:21 PM, Steve Tuecke wrote: > > > > > > > > > Globus Online is a service that we (University of > Chicago) run for the research community. It is not software > that is distributed for local operation, but rather is > "software as a service". Use of Globus Online for file > transfer and synchronization is free. You can sign up through > our web site, and create your own endpoints on servers with > Globus Connect Multi-User (https://www.globusonline.org/gcmu/) > and on personal computers with Globus Connect (available on > the dashboard after you login). We are just beginning beta > testing of additional features for big data sharing > (https://www.globusonline.org/plus/) that will be available > for a modest subscription fee in order to help sustain this > non-profit service. > > > > > > > > > > Regards, > > > > > -Steve > > > > > > > > > > On Mar 12, 2013, at 4:42 AM, Guillermo Marco Puche > <[email protected]> wrote: > > > > > > > > > > > Hello, > > > > > > > > > > > > I'm new to Globus. I've not been capable to install > Globus yet. > > > > > > I'm interested in installing Globus to allow my > users to upload big chunks of data. > > > > > > > > > > > > I've been playing around with Globus Online and I > like the web interface. > > > > > > Is that web interface being distributed to use it? > > > > > > > > > > > > Thank you, > > > > > > > > > > > > Best regards, > > > > > > Guillermo. > > > > > > > > ------------------------------ > > _______________________________________________ > gt-user mailing list > [email protected] > https://lists.globus.org/mailman/listinfo/gt-user > > End of gt-user Digest, Vol 54, Issue 6 > ************************************** > >
