Re: [galaxy-user] Need your helps about Galaxy
Hi all, Larry got another problem on our cloud Galaxy ( http://galaxyclass.genenetwork.org/). He cannot execute some commands successfully: /opt/sge/default/spool/execd/ip-10-184-11-27/job_scripts/152: line 13: wigToBigWig: command not found /opt/sge/default/spool/execd/ip-10-152-136-219/job_scripts/72: line 13: bedtools: command not found /opt/sge/default/spool/execd/ip-10-152-136-219/job_scripts/72: line 13: bedGraphToBigWig: command not found I tried to fix it, but still no ideas so far. I checked something on the master and on all the nodes, everything looks right for me. Please see an attached file. Does anybody have any ideas for this? Thanks a lot. Lei Yan Center for Integrative and Translational Genomics The University of Tennessee Health Science Center attachment: 2013-10-01 11-33-36 AM.png___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
[galaxy-user] question about samtools in Galaxy
Hi, Can anyone tell me if the ability to randomly sample a sam or bam file (view -s) is available via Galaxy samtools? I can't find it but it might be an option that I am missing. sincerely, Robert Jackman rais...@gmail.com rjack...@bu.edu ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Re: [galaxy-user] question about samtools in Galaxy
Hi Robert, This function is not wrapped into a tool yet by the dev team. I checked the Tool Shed as well and didn't see it there. But there is another option to get to the same result. The tool Text Manipulation - Select random lines from a file can be used with a SAM file. Don't not use the tool on a BAM file. Hopefully this helps! Jen Galaxy team On 10/1/13 12:13 PM, Robert Jackman wrote: Hi, Can anyone tell me if the ability to randomly sample a sam or bam file (view -s) is available via Galaxy samtools? I can't find it but it might be an option that I am missing. sincerely, Robert Jackman rais...@gmail.com rjack...@bu.edu ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ -- Jennifer Hillman-Jackson http://galaxyproject.org ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
[galaxy-user] Tophat Error: segment-based junction search failed with err
Hello, I don't know why I still have this problem.. I have run tophat2 with different dataset, sometimes it goes well but sometime I have this error. I run only one job at a time on a virtual machine with 8G memory without using galaxy plateform. I tried --no-coverage-search option but it changes nothing. Thanks. Delong De : Delong, Zhou Envoyé : 27 août 2013 9:36 À : galaxy-u...@bx.psu.edu Objet : Tophat Error: segment-based junction search failed with err Hello, I have run several analysis with Tophat 2 on my local instance of galaxy and I get this error for all of them.. segment-based junction search failed with err = 1 or -9 Here is an example of full error report: Error in tophat: [2013-08-23 11:56:58] Beginning TopHat run (v2.0.6) --- [2013-08-23 11:56:58] Checking for Bowtie Bowtie version:2.0.2.0 [2013-08-23 11:56:58] Checking for Samtools Samtools version:0.1.18.0 [2013-08-23 11:56:58] Checking for Bowtie index files [2013-08-23 11:56:58] Checking for reference FASTA file [2013-08-23 11:56:58] Generating SAM header for /usr/local/data/bowtie2/hg19/hg19 format: fastq quality scale: phred33 (default) [2013-08-23 11:58:04] Preparing reads left reads: min. length=50, max. length=50, 145339247 kept reads (34946 discarded) right reads: min. length=50, max. length=50, 145340153 kept reads (34040 discarded) [2013-08-23 14:16:21] Mapping left_kept_reads to genome hg19 with Bowtie2 [2013-08-24 01:04:37] Mapping left_kept_reads_seg1 to genome hg19 with Bowtie2 (1/2) [2013-08-24 03:38:22] Mapping left_kept_reads_seg2 to genome hg19 with Bowtie2 (2/2) [2013-08-24 05:29:58] Mapping right_kept_reads to genome hg19 with Bowtie2 [2013-08-24 19:50:22] Mapping right_kept_reads_seg1 to genome hg19 with Bowtie2 (1/2) [2013-08-24 22:36:38] Mapping right_kept_reads_seg2 to genome hg19 with Bowtie2 (2/2) [2013-08-25 01:40:37] Searching for junctions via segment mapping Coverage-search algorithm is turned on, making this step very slow Please try running TopHat again with the option (--no-coverage-search) if this step takes too much time or memory. [FAILED] Error: segment-based junction search failed with err =-9 Collecting potential splice sites in islands cp: cannot stat `/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/deletions.bed': No such file or directory cp: cannot stat `/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/insertions.bed': No such file or directory I did some research on the internet and it seems to be a memory problem to me, is there any solution other than rerun these jobs on a more powerful machine? And why has Bowtie/Tophat discard different numbers of reads? What will be the impact? Does it means that if I don't have exact matches between the paired end input, it is still be possible to run the job? Thanks, Delong ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Re: [galaxy-user] Tophat Error: segment-based junction search failed with err
Hi Delong, If you are mapping against a large reference genome and your datasets are large, 8G of memory may simply not be enough, even with omitting this paramater. Also, if you have set other TopHat parameters to be sensitive, then those can also be contributing to memory usage. Splitting the job up is still an option to try, as in the original post: http://gmod.827538.n3.nabble.com/Tophat-Error-segment-based-junction-search-failed-with-err-td4035978.html On 10/2/13 10:20 AM, Delong, Zhou wrote: Hello, I don't know why I still have this problem.. I have run tophat2 with different dataset, sometimes it goes well but sometime I have this error. There are likely content differences between the datasets. A tool such as FastQC is a good one to use to investigate. I run only one job at a time on a virtual machine with 8G memory without using galaxy plateform. I tried --no-coverage-search option but it changes nothing. Do you mean that the tool fails on the line command? Then it will also fail in Galaxy using the same resources, this is expected. If you do not want to split the job up, you could consider a Cloud Galaxy: http://usegalaxy.org/cloud Best, Jen Galaxy team Thanks. Delong *De :* Delong, Zhou *Envoyé :* 27 août 2013 9:36 *À :* galaxy-u...@bx.psu.edu *Objet :* Tophat Error: segment-based junction search failed with err Hello, I have run several analysis with Tophat 2 on my local instance of galaxy and I get this error for all of them.. segment-based junction search failed with err = 1 or -9 Here is an example of full error report: Error in tophat: [2013-08-23 11:56:58] Beginning TopHat run (v2.0.6) --- [2013-08-23 11:56:58] Checking for Bowtie Bowtie version:2.0.2.0 [2013-08-23 11:56:58] Checking for Samtools Samtools version:0.1.18.0 [2013-08-23 11:56:58] Checking for Bowtie index files [2013-08-23 11:56:58] Checking for reference FASTA file [2013-08-23 11:56:58] Generating SAM header for /usr/local/data/bowtie2/hg19/hg19 format: fastq quality scale: phred33 (default) [2013-08-23 11:58:04] Preparing reads left reads: min. length=50, max. length=50, 145339247 kept reads (34946 discarded) right reads: min. length=50, max. length=50, 145340153 kept reads (34040 discarded) [2013-08-23 14:16:21] Mapping left_kept_reads to genome hg19 with Bowtie2 [2013-08-24 01:04:37] Mapping left_kept_reads_seg1 to genome hg19 with Bowtie2 (1/2) [2013-08-24 03:38:22] Mapping left_kept_reads_seg2 to genome hg19 with Bowtie2 (2/2) [2013-08-24 05:29:58] Mapping right_kept_reads to genome hg19 with Bowtie2 [2013-08-24 19:50:22] Mapping right_kept_reads_seg1 to genome hg19 with Bowtie2 (1/2) [2013-08-24 22:36:38] Mapping right_kept_reads_seg2 to genome hg19 with Bowtie2 (2/2) [2013-08-25 01:40:37] Searching for junctions via segment mapping Coverage-search algorithm is turned on, making this step very slow Please try running TopHat again with the option (--no-coverage-search) if this step takes too much time or memory. [FAILED] Error: segment-based junction search failed with err =-9 Collecting potential splice sites in islands cp: cannot stat `/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/deletions.bed': No such file or directory cp: cannot stat `/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/insertions.bed': No such file or directory I did some research on the internet and it seems to be a memory problem to me, is there any solution other than rerun these jobs on a more powerful machine? And why has Bowtie/Tophat discard different numbers of reads? What will be the impact? Does it means that if I don't have exact matches between the paired end input, it is still be possible to run the job? Thanks, Delong ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ -- Jennifer Hillman-Jackson http://galaxyproject.org ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of
[galaxy-user] URL problem
Alper, Did you problem get resolved already? Maybe on the galaxy-...@bx.psu.edu mailing list? I am posting it there in case it is still open. Please reply to let us know your current status. Please drop galaxy-u...@bx.psu.edu from the to/cc on reply and future posts to this thread. Thanks and sorry if this one got missed, Jen Galaxy team On 8/26/13 10:43 AM, Kucukural, Alper wrote: Hi, I have a problem in galaxy to get host/domain name in two different pages. First one is in the tool installation from toolshed, I got the error below, # Not Found The requested URL /admin_toolshed/prepare_for_install was not found on this server. # The second one is in the saved histories. When I click the buttons of the saved histories. I got the similar error like below. # Not Found The requested URL /history/list was not found on this server. # I haven't seen these any other pages yet. My installation is working on LDAP authentication with Proxy. So, I could not find a place to set the domain or host name in these two places that they can actually find the requested URLs. In the paster.log file. I don't get any error when I install a tool or go to another history. It doesn't report any error. Thanks for your help, Alper Kucukural ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ -- Jennifer Hillman-Jackson http://galaxyproject.org ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Re: [galaxy-user] queue rules for multi-step workflows
Hi Zuzana, Jobs queue individually. But different jobs may queue to different clusters, so if there are no dependencies, you may see jobs execute out of order. Workflows are still a benefit as this places jobs in the queue sooner than waiting for each job to finished (under normal circumstances - not the extended queue times seen now during the server reconfiguration). The banner on main provides updates about the status of Main, but right now NGS jobs are in hold. We expect these to start again tomorrow and then for the final stages of the upgrades to be complete within the next few weeks. Apologies for the slow reply to your question, Jen Galaxy team On 7/24/13 2:33 PM, zuzmus wrote: Dear Galaxy managers, I would like to ask about the queuing rules for the workflows before processed on the server? I use my customized Galaxy workflow which contains 22 following steps (basically, filtering, trimming and format change of NGS data). I guess the server is generally very busy during last weeks/months (?), so my job was waiting about 24 hours in a queue (which would not be a problem), and then the first step of the workflow was processed, but the following 21 is again/still waiting (already for another couple of hours...). It makes me wondering about the queuing rules because I expected that the whole workflow is queued as one job.. Then my question is if the whole workflow, once submitted, is listed in the queue, or does the following step queue only after the previous step is finished (which would mean to wait the whole queue for each step of the workflow...)? I routinely used those wrokflows before (months ago) without any problems... I tried to search similar question in the archive before I posted this one... Thanks a lot for your answer, My best Zuzana Musilova -- Zuzana Musilova, PhD. (zuz...@gmail.com mailto:zuz...@gmail.com) Zoological Institute University of Basel Vesalgasse 1, CH-4051 Basel Switzerland - Europe ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ -- Jennifer Hillman-Jackson http://galaxyproject.org ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Re: [galaxy-user] URL problem
Yes it is solved thanks Sent from my iPhone On Oct 2, 2013, at 6:14 PM, Jennifer Jackson j...@bx.psu.edu wrote: Alper, Did you problem get resolved already? Maybe on the galaxy-...@bx.psu.edu mailing list? I am posting it there in case it is still open. Please reply to let us know your current status. Please drop galaxy-u...@bx.psu.edu from the to/cc on reply and future posts to this thread. Thanks and sorry if this one got missed, Jen Galaxy team On 8/26/13 10:43 AM, Kucukural, Alper wrote: Hi, I have a problem in galaxy to get host/domain name in two different pages. First one is in the tool installation from toolshed, I got the error below, # Not Found The requested URL /admin_toolshed/prepare_for_install was not found on this server. # The second one is in the saved histories. When I click the buttons of the saved histories. I got the similar error like below. # Not Found The requested URL /history/list was not found on this server. # I haven't seen these any other pages yet. My installation is working on LDAP authentication with Proxy. So, I could not find a place to set the domain or host name in these two places that they can actually find the requested URLs. In the paster.log file. I don't get any error when I install a tool or go to another history. It doesn't report any error. Thanks for your help, Alper Kucukural ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ -- Jennifer Hillman-Jackson http://galaxyproject.org ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
[galaxy-user] Please save these dates! GCC2014: June 30 - July 2
Hello all, The 2014 Galaxy Community Conference (GCC2014)http://wiki.galaxyproject.org/Events/GCC2014 has been scheduled for June 30 through July 2, at the Homewood Campushttp://webapps.jhu.edu/jhuniverse/information_about_hopkins/campuses/homewood_campus/ of Johns Hopkins University http://jhu.edu/, in Baltimore, Marylandhttp://visitors.baltimorecity.gov/, United States. Galaxy Community Conferences are an opportunity to participate in presentations, discussions, poster sessions, lightning talks and breakouts, all about high-throughput biology and the tools that support it. The conference will also includes a*Training Day* offering in-depth topic coverage, across several concurrent sessions. See the GCC2013 web sitehttp://wiki.galaxyproject.org/Events/GCC2013 for an idea of what happens at a Galaxy Community Conference. See you next summer, GCC2014 Organizing Committeehttp://wiki.galaxyproject.org/Events/GCC2014/Organizers -- http://galaxyproject.org/ http://getgalaxy.org/ http://usegalaxy.org/ http://wiki.galaxyproject.org/ ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
[galaxy-user] Can TopHat take SNPs into account?
Hi, I have been mapping my RNA-seq data to mouse genome from a different mouse strain using TopHat. I am wondering whether TopHat can take SNPs into account during the alignment? ( using SNPs track as an optional input)? Thanks Thanh ___ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using reply all in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/