Re: [galaxy-dev] Galaxy and object stores

2014-08-26 Thread John Chilton
Thanks Enis, just to elaborate on Pulsar - I suspect it would work with something like configuring Galaxy with S3 object store right now - but it would do so by having Galaxy cache the data locally and then Pulsar would negotiate the transfer with Galaxy (many different ways this could occur depend

Re: [galaxy-dev] Galaxy and object stores

2014-08-26 Thread Enis Afgan
Hi Inge, There is an implementation for using the AWS S3 object store as the data store for a given Galaxy instance. The implementation is located here https://bitbucket.org/galaxy/galaxy-central/src/3a51eaf209f2502bf32dbb421ecabb7fe46243ea/lib/galaxy/objectstore/s3.py?at=default and it offers seve

[galaxy-dev] Galaxy and object stores

2014-08-25 Thread Raknes Inge Alexander
?I have a few questions about object stores in Galaxy: 1: Can all Galaxy data sets be stored in an object store? 2: If so, does Galaxy still need to maintain a local copy of the data? 3: Is LWR or Pulsar able to get the data directly from the object store, or does it still have to go through Ga