Hi Guillermo,
In the company I work, we have faced a similar issue. We needed to
offer a web interface to our users in order to use Globus to transfer
data sets with high performance. We also tried Globus Online but
although the data doesn't pass through GO, our security policy doesn't
allowed used it. We also did the same questions to GO Team about a web
interface to use it in our facilities.
Because all of this, we decided to build an in house solution with
GridFTP. This solution is based on jGlobus API - Globus Java API
(www.globus.org/toolkit/jglobus). With this API we built a Java Web
application with a database, for persistence same parameters,
deployed in an application server. This tool provides a user-friendly
interface with resume in case of data connection failure, TCP parallel
data connection to improve the performance, scheduled transfer and
integrity checking, this feature checks the file block-by-block after
the transfer and re-transmits only corrupted blocks.
If you have the opportunity to attend CCGrid 2013, I'll be there
presenting a Poster about our solution.
Best Regards.
Fabio de Souza
----------------------------------------------------------------------
Message: 1
Date: Thu, 14 Mar 2013 08:39:18 +1300
From: Markus Binsteiner <[email protected]>
To: Guillermo Marco Puche
<[email protected]>
Cc: [email protected]
Subject: Re: [gt-user] Globus GridFTP web interface.
Message-ID: <1363203558.3395.6.camel@think>
Content-Type: text/plain; charset="UTF-8"
Hi Guillermo,
the data transfer part is only a small part of what I
implemented. It's
a grid-client framework called Grisu:
https://github.com/grisu/grisu
And its purpose is to make access to (mostly compute) grid
infrastructure easier. Since a lot of data starts up or has to
end up on
the users' desktop, I needed to find a solution to get data
from/to
there. http turned out to be the best solution, because that
traffic is
the most likely to get through the firewall, or can at least
be proxied
via a http proxy.
Anyway, my solution uses commons-vfs, which is a virtual
filesystem
library to forward-stream the data to the gridftp endpoints
from the
portal. It works, but I did not spend any work on making it
faster or
anything like that. There are a few more frameworks/APIs
involved, happy
to explain in more detail if necessary.
Cheers,
Markus
On Wed, 2013-03-13 at 11:21 +0100, Guillermo Marco Puche
wrote:
> Hello Markus,
>
> Could I see the solution you implemented? Did you use any
API to start
> developing your frontend?
>
> Thank you.
>
> Best regards,
> Guillermo.
>
> On 03/13/2013 10:24 AM, Markus Binsteiner wrote:
>
> > Guillermo,
> >
> > I don't think there exists a webclient for GridFTP, apart
from the one
> > that is part of GlobusOnline. And even with GlobusOnline
you can't
> > "upload" files. They would have to use GlobusConnect,
which they need to
> > install on their desktop machine. GlobusConnect is
basically a gridftp
> > server, just bundled up for easy install, without having
to worry (too
> > much) about the authentication side of things.
> >
> > Once that is installed, users can kick off (and monitor)
transfers from
> > the GlobusOnline website. Since that will be a 3rd party
gridftp
> > transfer it'll be quite fast. But it can introduce a few
problems with
> > firewalls and such, since the ports that need to be open
are often (in
> > my experience anyway) closed by University/company
firewalls. Your
> > mileage may vary though.
> >
> > I guess one could write a webfrontend for gridftp, where
users could
> > upload files via http and then the portal would forward
the files to the
> > endpoint via gridftp. I implemented a similar solution as
a SOAP
> > webservice. But it'd be quite a substantial piece of work.
Even if you
> > wouldn't have to worry about how to implement the
authentication part.
> > Which you probably would have to do.
> >
> > So, in short: I'd recommend you have a look at
GlobusConnect and accept
> > that users need to install something on their desktop
machines.
> > Everything else will be a lot of work...
> >
> > Good luck!
> >
> > Markus
> >
> > On Wed, 2013-03-13 at 09:21 +0100, Guillermo Marco Puche
wrote:
> > > Hello Steve,
> > >
> > > That seems very interesting. Although I haven't tested
deeply Globus
> > > Online.
> > > I'm in need to provide my users a web interface to
upload big data
> > > files. I thought then that Globus could be a very good
option. Since
> > > it's a tested and trusted system.
> > > But I also thought that web interface in Globus Online
was available.
> > >
> > > I think what I really need is a web client for Gridftp,
maybe I?m
> > > wrong. I'm a bit confused and I can't really find a tool
that covers
> > > my needs. That's why I'm asking. Any guidelines or
information about
> > > tools will be appreciated.
> > >
> > > Thank you very much.
> > >
> > > Best regards,
> > > Guillermo.
> > >
> > > On 03/12/2013 06:21 PM, Steve Tuecke wrote:
> > >
> > > > Globus Online is a service that we (University of
Chicago) run for the research community. It is not software
that is distributed for local operation, but rather is
"software as a service". Use of Globus Online for file
transfer and synchronization is free. You can sign up through
our web site, and create your own endpoints on servers with
Globus Connect Multi-User (https://www.globusonline.org/gcmu/)
and on personal computers with Globus Connect (available on
the dashboard after you login). We are just beginning beta
testing of additional features for big data sharing
(https://www.globusonline.org/plus/) that will be available
for a modest subscription fee in order to help sustain this
non-profit service.
> > > >
> > > > Regards,
> > > > -Steve
> > > >
> > > > On Mar 12, 2013, at 4:42 AM, Guillermo Marco Puche
<[email protected]> wrote:
> > > >
> > > > > Hello,
> > > > >
> > > > > I'm new to Globus. I've not been capable to install
Globus yet.
> > > > > I'm interested in installing Globus to allow my
users to upload big chunks of data.
> > > > >
> > > > > I've been playing around with Globus Online and I
like the web interface.
> > > > > Is that web interface being distributed to use it?
> > > > >
> > > > > Thank you,
> > > > >
> > > > > Best regards,
> > > > > Guillermo.
> >
------------------------------
_______________________________________________
gt-user mailing list
[email protected]
https://lists.globus.org/mailman/listinfo/gt-user
End of gt-user Digest, Vol 54, Issue 6
**************************************
