Re: [galaxy-dev] uploading multi-file archives and creation of potentially large collections

2016-08-07 Thread John Chilton
Just to provide a little more detail on the collection point... Daniel Blankenberg presented a talk at the Galaxy Community Conference on metagenomics that talked a lot about "large" collection handling in Galaxy - https://gcc16.sched.org/event/5Y0M/metagenomics-with-galaxy. I think his rule of thu

Re: [galaxy-dev] uploading multi-file archives and creation of potentially large collections

2016-08-05 Thread Björn Grüning
Hi Stephan and Gildas, I think a tool is a nice addition. Archives can be arbitrary complex and nested so a tool would make perfect sense. If this tools is working well and we know which features we need and how they should be displayed to the user it more easy to move these kind of functionality

Re: [galaxy-dev] uploading multi-file archives and creation of potentially large collections

2016-08-05 Thread Gildas Le Corguillé
Hi Stephan, I will only answer about uploading zip files. Since the release_16.04, a zip datatype is integrated within the Galaxy distribution. But without any sniffer, so your users will have to select, before the upload, the zip datatype manually. I also want to write this kind of tool which

[galaxy-dev] uploading multi-file archives and creation of potentially large collections

2016-08-04 Thread Stephan Oepen
colleagues, in our adaptation of galaxy for large-scale natural language processing, a fairly common use pattern is to invoke a workflow on a potentially large number of text files. hence, i am wondering about facilities for uploading an archive (in ‘.zip’ or ‘.tgz’ format, say) containing severa