Re: [galaxy-dev] Working with files outside galaxy without copying?

2012-11-15 Thread Samuel Lampa
Many thanks for the links, exectly what I need! (somehow missed to look in the right place, obviously ...) Best // Samuel On 11/14/2012 04:02 PM, Hans-Rudolf Hotz wrote: Hi Samuel Have you looked at Data Libraries ? (http://wiki.galaxyproject.org/Admin/Data%20Libraries/Libraries ) also look

[galaxy-dev] Working with files outside galaxy without copying?

2012-11-14 Thread Samuel Lampa
Hi, We are looking into ways to integrate galaxy into the workflows of users at our cluster, with lots of NGS users running all and any kind of analyses on their typically huge amounts of data. For this we use a parallel file system, available on all compute nodes. This file system,

Re: [galaxy-dev] Working with files outside galaxy without copying?

2012-11-14 Thread Jorrit Boekel
This may be implemented, I believe some people run Galaxy on the cluster, but if not: Galaxy normally operates on files stored in the database/files folder. If your Galaxy instance has access to the files you need on your parallel fs, I guess you could start by writing a tool that creates links

Re: [galaxy-dev] Working with files outside galaxy without copying?

2012-11-14 Thread Samuel Lampa
Hi Jorrit, thanks for the input! On 11/14/2012 03:12 PM, Jorrit Boekel wrote: This may be implemented, I believe some people run Galaxy on the cluster, Yes, but AFAIK, most cluster job runners use some kind of file staging (copying) into local storage on the compute nodes OR, require you do

Re: [galaxy-dev] Working with files outside galaxy without copying?

2012-11-14 Thread Hans-Rudolf Hotz
Hi Samuel Have you looked at Data Libraries ? (http://wiki.galaxyproject.org/Admin/Data%20Libraries/Libraries ) also look at the configurations in universe_wsgi.ini: library_import_dir user_library_import_dir allow_library_path_paste which gives you many option to access data out side of the