Re: [galaxy-user] Need your helps about Galaxy

2013-10-02 Thread Lei Yan
Hi all,

Larry got another problem on our cloud Galaxy (
http://galaxyclass.genenetwork.org/).
He cannot execute some commands successfully:
/opt/sge/default/spool/execd/ip-10-184-11-27/job_scripts/152: line 13:
wigToBigWig: command not found
/opt/sge/default/spool/execd/ip-10-152-136-219/job_scripts/72: line 13:
bedtools: command not found
/opt/sge/default/spool/execd/ip-10-152-136-219/job_scripts/72: line 13:
bedGraphToBigWig: command not found

I tried to fix it, but still no ideas so far. I checked something on the
master and on all the nodes, everything looks right for me. Please see an
attached file.

Does anybody have any ideas for this? Thanks a lot.


Lei Yan
Center for Integrative and Translational Genomics
The University of Tennessee Health Science Center
attachment: 2013-10-01 11-33-36 AM.png___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/

[galaxy-user] question about samtools in Galaxy

2013-10-02 Thread Robert Jackman

Hi,
Can anyone tell me if the ability to randomly sample a sam or bam file 
(view -s) is available via Galaxy samtools? I can't find it but it might 
be an option that I am missing.

sincerely,
Robert Jackman
rais...@gmail.com
rjack...@bu.edu
___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

 http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

 http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

 http://galaxyproject.org/search/mailinglists/


Re: [galaxy-user] question about samtools in Galaxy

2013-10-02 Thread Jennifer Jackson

Hi Robert,

This function is not wrapped into a tool yet by the dev team. I checked 
the Tool Shed as well and didn't see it there. But there is another 
option to get to the same result.


The tool Text Manipulation - Select random lines from a file can be 
used with a SAM file. Don't not use the tool on a BAM file.


Hopefully this helps!

Jen
Galaxy team

On 10/1/13 12:13 PM, Robert Jackman wrote:

Hi,
Can anyone tell me if the ability to randomly sample a sam or bam file 
(view -s) is available via Galaxy samtools? I can't find it but it 
might be an option that I am missing.

sincerely,
Robert Jackman
rais...@gmail.com
rjack...@bu.edu
___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

 http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

 http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

 http://galaxyproject.org/search/mailinglists/


--
Jennifer Hillman-Jackson
http://galaxyproject.org

___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

 http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

 http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

 http://galaxyproject.org/search/mailinglists/


[galaxy-user] Tophat Error: segment-based junction search failed with err

2013-10-02 Thread Delong, Zhou
Hello,
I don't know why I still have this problem..
I have run tophat2 with different dataset, sometimes it goes well but sometime 
I have this error.
I run only one job at a time on a virtual machine with 8G memory without using 
galaxy plateform. I tried --no-coverage-search option but it changes nothing.
Thanks.
Delong



De : Delong, Zhou
Envoyé : 27 août 2013 9:36
À : galaxy-u...@bx.psu.edu
Objet : Tophat Error: segment-based junction search failed with err

Hello,
I have run several analysis with Tophat 2 on my local instance of galaxy and I 
get this error for all of them..

segment-based junction search failed with err = 1 or -9

Here is an example of full error report:


Error in tophat:

[2013-08-23 11:56:58] Beginning TopHat run (v2.0.6)
---
[2013-08-23 11:56:58] Checking for Bowtie
  Bowtie version:2.0.2.0
[2013-08-23 11:56:58] Checking for Samtools
Samtools version:0.1.18.0
[2013-08-23 11:56:58] Checking for Bowtie index files
[2013-08-23 11:56:58] Checking for reference FASTA file
[2013-08-23 11:56:58] Generating SAM header for 
/usr/local/data/bowtie2/hg19/hg19
format:  fastq
quality scale:   phred33 (default)
[2013-08-23 11:58:04] Preparing reads
 left reads: min. length=50, max. length=50, 145339247 kept reads 
(34946 discarded)
right reads: min. length=50, max. length=50, 145340153 kept reads 
(34040 discarded)
[2013-08-23 14:16:21] Mapping left_kept_reads to genome hg19 with Bowtie2
[2013-08-24 01:04:37] Mapping left_kept_reads_seg1 to genome hg19 with Bowtie2 
(1/2)
[2013-08-24 03:38:22] Mapping left_kept_reads_seg2 to genome hg19 with Bowtie2 
(2/2)
[2013-08-24 05:29:58] Mapping right_kept_reads to genome hg19 with Bowtie2
[2013-08-24 19:50:22] Mapping right_kept_reads_seg1 to genome hg19 with Bowtie2 
(1/2)
[2013-08-24 22:36:38] Mapping right_kept_reads_seg2 to genome hg19 with Bowtie2 
(2/2)
[2013-08-25 01:40:37] Searching for junctions via segment mapping
Coverage-search algorithm is turned on, making this step very slow
Please try running TopHat again with the option (--no-coverage-search) 
if this step takes too much time or memory.
[FAILED]
Error: segment-based junction search failed with err =-9
Collecting potential splice sites in islands


cp: cannot stat 
`/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/deletions.bed':
 No such file or directory
cp: cannot stat 
`/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/insertions.bed':
 No such file or directory

I did some research on the internet and it seems to be a memory problem to me, 
is there any solution other than rerun these jobs on a more powerful machine?

And why has Bowtie/Tophat discard different numbers of reads? What will be the 
impact? Does it means that if I don't have exact matches between the paired end 
input, it is still be possible to run the job?

Thanks,
Delong
___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-user] Tophat Error: segment-based junction search failed with err

2013-10-02 Thread Jennifer Jackson

Hi Delong,

If you are mapping against a large reference genome and your datasets 
are large, 8G of memory may simply not be enough, even with omitting 
this paramater. Also, if you have set other TopHat parameters to be 
sensitive, then those can also be contributing to memory usage. 
Splitting the job up is still an option to try, as in the original post:

http://gmod.827538.n3.nabble.com/Tophat-Error-segment-based-junction-search-failed-with-err-td4035978.html

On 10/2/13 10:20 AM, Delong, Zhou wrote:

Hello,
I don't know why I still have this problem..
I have run tophat2 with different dataset, sometimes it goes well but 
sometime I have this error.
There are likely content differences between the datasets. A tool such 
as FastQC is a good one to use to investigate.
I run only one job at a time on a virtual machine with 8G memory 
without using galaxy plateform. I tried --no-coverage-search option 
but it changes nothing.
Do you mean that the tool fails on the line command? Then it will also 
fail in Galaxy using the same resources, this is expected.


If you do not want to split the job up, you could consider a Cloud Galaxy:
http://usegalaxy.org/cloud

Best,

Jen
Galaxy team

Thanks.
Delong



*De :* Delong, Zhou
*Envoyé :* 27 août 2013 9:36
*À :* galaxy-u...@bx.psu.edu
*Objet :* Tophat Error: segment-based junction search failed with err

Hello,
I have run several analysis with Tophat 2 on my local instance of 
galaxy and I get this error for all of them..


segment-based junction search failed with err = 1 or -9

Here is an example of full error report:

Error in tophat:

[2013-08-23 11:56:58] Beginning TopHat run (v2.0.6)
---
[2013-08-23 11:56:58] Checking for Bowtie
  Bowtie version:2.0.2.0
[2013-08-23 11:56:58] Checking for Samtools
Samtools version:0.1.18.0
[2013-08-23 11:56:58] Checking for Bowtie index files
[2013-08-23 11:56:58] Checking for reference FASTA file
[2013-08-23 11:56:58] Generating SAM header for 
/usr/local/data/bowtie2/hg19/hg19
format:  fastq
quality scale:   phred33 (default)
[2013-08-23 11:58:04] Preparing reads
 left reads: min. length=50, max. length=50, 145339247 kept reads 
(34946 discarded)
right reads: min. length=50, max. length=50, 145340153 kept reads 
(34040 discarded)
[2013-08-23 14:16:21] Mapping left_kept_reads to genome hg19 with Bowtie2
[2013-08-24 01:04:37] Mapping left_kept_reads_seg1 to genome hg19 with Bowtie2 
(1/2)
[2013-08-24 03:38:22] Mapping left_kept_reads_seg2 to genome hg19 with Bowtie2 
(2/2)
[2013-08-24 05:29:58] Mapping right_kept_reads to genome hg19 with Bowtie2
[2013-08-24 19:50:22] Mapping right_kept_reads_seg1 to genome hg19 with Bowtie2 
(1/2)
[2013-08-24 22:36:38] Mapping right_kept_reads_seg2 to genome hg19 with Bowtie2 
(2/2)
[2013-08-25 01:40:37] Searching for junctions via segment mapping
Coverage-search algorithm is turned on, making this step very slow
Please try running TopHat again with the option (--no-coverage-search) 
if this step takes too much time or memory.
[FAILED]
Error: segment-based junction search failed with err =-9
Collecting potential splice sites in islands


cp: cannot stat 
`/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/deletions.bed':
 No such file or directory
cp: cannot stat 
`/home/galaxy/galaxy-dist/database/job_working_directory/000/515/tophat_out/insertions.bed':
 No such file or directory

I did some research on the internet and it seems to be a memory 
problem to me, is there any solution other than rerun these jobs on a 
more powerful machine?


And why has Bowtie/Tophat discard different numbers of reads? What 
will be the impact? Does it means that if I don't have exact matches 
between the paired end input, it is still be possible to run the job?


Thanks,
Delong


___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

   http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

   http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

   http://galaxyproject.org/search/mailinglists/


--
Jennifer Hillman-Jackson
http://galaxyproject.org

___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of

[galaxy-user] URL problem

2013-10-02 Thread Jennifer Jackson

Alper,

Did you problem get resolved already? Maybe on the galaxy-...@bx.psu.edu 
mailing list?


I am posting it there in case it is still open. Please reply to let us 
know your current status.


Please drop galaxy-u...@bx.psu.edu from the to/cc on reply and future 
posts to this thread.


Thanks and sorry if this one got missed,

Jen
Galaxy team


On 8/26/13 10:43 AM, Kucukural, Alper wrote:

Hi,
I have a problem in galaxy to get host/domain name in two different 
pages.
First one is in the tool installation from toolshed, I got the error 
below,


#


  Not Found

The requested URL /admin_toolshed/prepare_for_install was not found on 
this server.


#

The second one is in the saved histories. When I click the buttons of 
the saved histories. I got the similar error like below.

#


  Not Found

The requested URL /history/list was not found on this server.

#

I haven't seen these any other pages yet.

My installation is working on LDAP authentication with Proxy. So, I 
could not find a place to set the domain or host name in these two 
places that they can actually find the requested URLs.


In the  paster.log file. I don't get any error when I install a tool 
or go to another history. It doesn't report any error.


Thanks for your help,

Alper Kucukural


___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

   http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

   http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

   http://galaxyproject.org/search/mailinglists/


--
Jennifer Hillman-Jackson
http://galaxyproject.org

___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-user] queue rules for multi-step workflows

2013-10-02 Thread Jennifer Jackson

Hi Zuzana,

Jobs queue individually. But different jobs may queue to different 
clusters, so if there are no dependencies, you may see jobs execute out 
of order. Workflows are still a benefit as this places jobs in the queue 
sooner than waiting for each job to finished (under normal circumstances 
- not the extended queue times seen now during the server reconfiguration).


The banner on main provides updates about the status of Main, but right 
now NGS jobs are in hold. We expect these to start again tomorrow and 
then for the final stages of the upgrades to be complete within the next 
few weeks.


Apologies for the slow reply to your question,

Jen
Galaxy team

On 7/24/13 2:33 PM, zuzmus wrote:

Dear Galaxy managers,

I would like to ask about the queuing rules for the workflows before 
processed on the server?


I use my customized Galaxy workflow which contains 22 following steps 
(basically, filtering, trimming and format change of NGS data). I 
guess the server is generally very busy during last weeks/months (?), 
so my job was waiting about 24 hours in a queue (which would not be a 
problem), and then the first step of the workflow was processed, but 
the following 21 is again/still waiting (already for another couple of 
hours...). It makes me wondering about the queuing rules because I 
expected that the whole workflow is queued as one job.. Then my 
question is if the whole workflow, once submitted, is listed in the 
queue, or does the following step queue only after the previous step 
is finished (which would mean to wait the whole queue for each step of 
the workflow...)?


I routinely used those wrokflows before (months ago) without any 
problems...


I tried to search similar question in the archive before I posted this 
one...


Thanks a lot for your answer,

My best

Zuzana Musilova
--
Zuzana Musilova, PhD.
(zuz...@gmail.com mailto:zuz...@gmail.com)

Zoological Institute
University of Basel
Vesalgasse 1, CH-4051 Basel
Switzerland - Europe


___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

   http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

   http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

   http://galaxyproject.org/search/mailinglists/


--
Jennifer Hillman-Jackson
http://galaxyproject.org

___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-user] URL problem

2013-10-02 Thread Alper Kucukural
Yes it is solved thanks

Sent from my iPhone

 On Oct 2, 2013, at 6:14 PM, Jennifer Jackson j...@bx.psu.edu wrote:
 
 Alper,
 
 Did you problem get resolved already? Maybe on the galaxy-...@bx.psu.edu 
 mailing list?
 
 I am posting it there in case it is still open. Please reply to let us know 
 your current status.
 
 Please drop galaxy-u...@bx.psu.edu from the to/cc on reply and future posts 
 to this thread.
 
 Thanks and sorry if this one got missed,
 
 Jen
 Galaxy team
 
 
 On 8/26/13 10:43 AM, Kucukural, Alper wrote:
 Hi,
 I have a problem in galaxy to get host/domain name in two different pages. 
 First one is in the tool installation from toolshed, I got the error below,
 
 #
 Not Found
 
 The requested URL /admin_toolshed/prepare_for_install was not found on this 
 server.
 
 #
 
 The second one is in the saved histories. When I click the buttons of the 
 saved histories. I got the similar error like below. 
 #
 Not Found
 
 The requested URL /history/list was not found on this server. 
 
 #
 
 I haven't seen these any other pages yet. 
 
 My installation is working on LDAP authentication with Proxy. So, I could 
 not find a place to set the domain or host name in these two places that 
 they can actually find the requested URLs.
 
 In the  paster.log file. I don't get any error when I install a tool or go 
 to another history. It doesn't report any error. 
 
 Thanks for your help,
 
 Alper Kucukural
   
 
 
 ___
 The Galaxy User list should be used for the discussion of
 Galaxy analysis and other features on the public server
 at usegalaxy.org.  Please keep all replies on the list by
 using reply all in your mail client.  For discussion of
 local Galaxy instances and the Galaxy source code, please
 use the Galaxy Development list:
 
   http://lists.bx.psu.edu/listinfo/galaxy-dev
 
 To manage your subscriptions to this and other Galaxy lists,
 please use the interface at:
 
   http://lists.bx.psu.edu/
 
 To search Galaxy mailing lists use the unified search at:
 
   http://galaxyproject.org/search/mailinglists/
 
 -- 
 Jennifer Hillman-Jackson
 http://galaxyproject.org
___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/

[galaxy-user] Please save these dates! GCC2014: June 30 - July 2

2013-10-02 Thread Dave Clements
Hello all,

The 2014 Galaxy Community Conference
(GCC2014)http://wiki.galaxyproject.org/Events/GCC2014 has
been scheduled for June 30 through July 2, at the Homewood
Campushttp://webapps.jhu.edu/jhuniverse/information_about_hopkins/campuses/homewood_campus/
 of Johns Hopkins University http://jhu.edu/, in Baltimore,
Marylandhttp://visitors.baltimorecity.gov/,
United States.

Galaxy Community Conferences are an opportunity to participate in
presentations, discussions, poster sessions, lightning talks and breakouts,
all about high-throughput biology and the tools that support it.  The
conference will also includes a*Training Day* offering in-depth topic
coverage, across several concurrent sessions.  See the GCC2013 web
sitehttp://wiki.galaxyproject.org/Events/GCC2013 for
an idea of what happens at a Galaxy Community Conference.

See you next summer,

GCC2014 Organizing
Committeehttp://wiki.galaxyproject.org/Events/GCC2014/Organizers

-- 
http://galaxyproject.org/
http://getgalaxy.org/
http://usegalaxy.org/
http://wiki.galaxyproject.org/
___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/

[galaxy-user] Can TopHat take SNPs into account?

2013-10-02 Thread Hoang, Thanh
Hi,
I have been mapping my RNA-seq data to mouse genome from a different mouse
strain using TopHat. I am  wondering whether TopHat can take SNPs into
account during the alignment? ( using SNPs track as an optional input)?
Thanks
Thanh
___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

  http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:

  http://galaxyproject.org/search/mailinglists/