[galaxy-dev] pass more information on a dataset merge

2012-10-01 Thread Jorrit Boekel
Dear list, I thought I was working with fairly large datasets, but they have recently started to include ~2Gb files in sets of 50. I have ran these sort of things before as merged data by using tar to roll them up in one set, but when dealing with 100Gb tarfiles, Galaxy on EC2 seems to get

[galaxy-dev] Coupling the output of two tools

2012-10-01 Thread Robert Chase
Hello, We added batch gfPcr as a tool in galaxy by writing a wrapper. We wrote another tool in python to modify the output of this tool (we increment the starts of the intervals by 1 to make the starting intervals 1 based) and wrote a wrapper for this other tool. Is is possible to couple these

Re: [galaxy-dev] Coupling the output of two tools

2012-10-01 Thread Peter Cock
On Fri, Sep 28, 2012 at 11:28 PM, Robert Chase re...@channing.harvard.edu wrote: Hello, We added batch gfPcr as a tool in galaxy by writing a wrapper. We wrote another tool in python to modify the output of this tool (we increment the starts of the intervals by 1 to make the starting

Re: [galaxy-dev] HYPHY tools

2012-10-01 Thread Nate Coraor
On Sep 10, 2012, at 6:29 PM, Julian Pradinuk wrote: Hi all, Could someone please point me to helpful ressources for installing HYPHY in Galaxy? • I've downloaded, compiled and installed HyPhy • I've copied the contents of the installation folder to

Re: [galaxy-dev] LDAP integration and migration of users

2012-10-01 Thread Nate Coraor
On Sep 11, 2012, at 5:01 AM, Joachim Jacob wrote: Hi all, I wonder if somebody with experience could enlighten me on these issues regarding authentication of users. - is it possible to have LDAP integration simultaneously with local Galaxy users. What I want to reach is when LDAP

Re: [galaxy-dev] markupsafe module conflicts

2012-10-01 Thread Nate Coraor
On Sep 11, 2012, at 12:09 PM, Fenglou Mao wrote: Galaxy imported a library which already existed in the python system folder. See the error message below. /home/x/work/galaxy-dist/lib/galaxy/__init__.py:79: UserWarning: Module markupsafe was already imported from

Re: [galaxy-dev] Size of the genome indexes repos in Galaxy Main

2012-10-01 Thread Nate Coraor
On Sep 20, 2012, at 7:55 AM, Derrick Lin wrote: Hi Nate, We downloaded the entire indexes repos and our guys are planning to write a script to generate loc files based on the given path to the repos. We are wondering if the galaxy team will release the loc files that are being used in

Re: [galaxy-dev] Orphan dataset created by history Export to File (possibly a bug?)

2012-10-01 Thread Nate Coraor
Hi Derrick, If you're using Postgres, it's now possible to clean these up using galaxy-dist/scripts/cleanup_datasets/pgcleanup.py --nate On Sep 13, 2012, at 11:55 PM, Derrick Lin wrote: Thanks Jeremy, I am sure it's trivial for us to do a manual clean up Cheers, D On Fri, Sep 14,

Re: [galaxy-dev] Issues up/downloading datasets after file_path change

2012-10-01 Thread Nate Coraor
Hi Josh, Are you using XSendFile or X-Accel-Redirect, by any chance? --nate On Sep 17, 2012, at 5:18 PM, Josh Nielsen wrote: Okay, I solved half of the problem. The upload job was consistently being submitted to the one compute node in our cluster that I forgot to create the symlink on

Re: [galaxy-dev] speed and large file question (after tying galaxy to Pittsburgh)

2012-10-01 Thread Nate Coraor
On Sep 18, 2012, at 11:56 AM, Joseph Hargitai wrote: Hi, General: Is there a quantifiable difference in data uploads, speed of processing, general availability after the connection was/is established to Pittsburgh? Hi Joe, I haven't tested it within the front end of Galaxy to see whether

[galaxy-dev] October 2012 Galaxy Update

2012-10-01 Thread Dave Clements
Hello all, The October 2012 Galaxy Update is now availablehttp://wiki.g2.bx.psu.edu/GalaxyUpdates/2012_10 :** - Upcoming Events and Deadlineshttp://wiki.g2.bx.psu.edu/GalaxyUpdates/2012_10#Upcoming_Events_and_Deadlines - 35 new

Re: [galaxy-dev] Orphan dataset created by history Export to File (possibly a bug?)

2012-10-01 Thread Derrick Lin
Sorry Nate, We are using MySQL so cannot verify this. We are happy to try once the MySQL alternative's released. Regards, Derrick On Tue, Oct 2, 2012 at 2:16 AM, Nate Coraor n...@bx.psu.edu wrote: Hi Derrick, If you're using Postgres, it's now possible to clean these up using