[galaxy-dev] Galaxy crach while visualization

2012-07-17 Thread Chebbi Mohamed Amine
Hello Galaxy team !

I have e strange problem whith my Galaxy trackster visualization . While
viewing bookmarked regions in my visualisation the whole
Galaxy process crashed and needed to be restarted, mainly when I use Chrome
browser.

Above the Paster.log :

xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1183972high=1185154mode=Autoresolution=2.954022988505747dataset_id=f4b17be90d9b3c9dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1182790high=1183972mode=Autoresolution=2.954022988505747dataset_id=ec90add676cb0ccehda_ldda=hdafilter_cols=%5B%22Mapping+Quality%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1181609high=1182791mode=Autoresolution=2.954022988505747dataset_id=ec90add676cb0ccehda_ldda=hdafilter_cols=%5B%22Mapping+Quality%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1183972high=1185154mode=Autoresolution=2.954022988505747dataset_id=ec90add676cb0ccehda_ldda=hdafilter_cols=%5B%22Mapping+Quality%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1180427high=1181609mode=Autoresolution=2.954022988505747dataset_id=cc26e7b927e75a3dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1181609high=1182791mode=Autoresolution=2.954022988505747dataset_id=cc26e7b927e75a3dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4)
AppleWebKit/536.11 (KHTML, like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET
/galaxy/tracks/data?chrom=chr19low=1182790high=1183972mode=Autoresolution=2.954022988505747dataset_id=cc26e7b927e75a3dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11
xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:37 +0200] GET
/galaxy/tracks/data?chrom=chr19low=814128high=815310mode=Autoresolution=2.954022988505747dataset_id=7710e7c5028b7c3bhda_ldda=hdafilter_cols=%5B%22Score%22%5D
HTTP/1.1 200 - 
http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output;
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML,
like Gecko) Chrome/20.0.1132.47 Safari/536.11

PostgreSQL saw the crach :

2012-07-12 12:56:40 CEST LOG:  could not receive data from client:
Connection reset by peer
2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:00:46.907
user=user database=database host=server port=33106
2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:03:45.206
user=user database=database host=server port=42867
2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:06:43.257
user=user database=database host=server port=56383
2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:04:22.120
user=user database=database host=server port=42663
2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:04:22.596
user=user database=database host=server port=42656


Thanks
Amine
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other 

Re: [galaxy-dev] cannot fetch egg svgfig from http://eggs.g2.bx.psu.edu

2012-07-17 Thread Di Pe
This is still not working.

is it just me ?



galaxdev@galaxy1:~$ hg clone https://bitbucket.org/galaxy/galaxy-dist
galaxy-dist3
requesting all changes
adding changesets
adding manifests
adding file changes
added 7149 changesets with 28071 changes to 5807 files
updating to branch default
3772 files updated, 0 files merged, 0 files removed, 0 files unresolved
galaxdev@galaxy1:~$ cd galaxy-dist3
galaxdev@galaxy1:~/galaxy-dist3$ galaxy-slurm-setup
slurm config written to universe_wsgi.ini
drmaa config written to eggs.ini
This is a new install. Do you also want to configure this instance for
production? [Y/N]: n
galaxdev@galaxy1:~/galaxy-dist3$
galaxdev@galaxy1:~/galaxy-dist3$ sh ./run.sh
Initializing community_wsgi.ini from community_wsgi.ini.sample
Initializing datatypes_conf.xml from datatypes_conf.xml.sample
Initializing external_service_types_conf.xml from
external_service_types_conf.xml.sample
Initializing migrated_tools_conf.xml from migrated_tools_conf.xml.sample
Initializing reports_wsgi.ini from reports_wsgi.ini.sample
Initializing shed_tool_conf.xml from shed_tool_conf.xml.sample
Initializing tool_conf.xml from tool_conf.xml.sample
Initializing tool_data_table_conf.xml from tool_data_table_conf.xml.sample
Initializing tool_sheds_conf.xml from tool_sheds_conf.xml.sample
Initializing openid_conf.xml from openid_conf.xml.sample
Initializing tool-data/shared/ucsc/builds.txt from builds.txt.sample
Initializing tool-data/shared/igv/igv_build_sites.txt from
igv_build_sites.txt.sample
Initializing tool-data/shared/rviewer/rviewer_build_sites.txt from
rviewer_build_sites.txt.sample
Initializing tool-data/add_scores.loc from add_scores.loc.sample
Initializing tool-data/alignseq.loc from alignseq.loc.sample
Initializing tool-data/all_fasta.loc from all_fasta.loc.sample
Initializing tool-data/annotation_profiler_options.xml from
annotation_profiler_options.xml.sample
Initializing tool-data/annotation_profiler_valid_builds.txt from
annotation_profiler_valid_builds.txt.sample
Initializing tool-data/bfast_indexes.loc from bfast_indexes.loc.sample
Initializing tool-data/binned_scores.loc from binned_scores.loc.sample
Initializing tool-data/blastdb.loc from blastdb.loc.sample
Initializing tool-data/blastdb_p.loc from blastdb_p.loc.sample
Initializing tool-data/bowtie2_indices.loc from bowtie2_indices.loc.sample
Initializing tool-data/bowtie_indices.loc from bowtie_indices.loc.sample
Initializing tool-data/bowtie_indices_color.loc from
bowtie_indices_color.loc.sample
Initializing tool-data/bwa_index.loc from bwa_index.loc.sample
Initializing tool-data/bwa_index_color.loc from bwa_index_color.loc.sample
Initializing tool-data/ccat_configurations.loc from
ccat_configurations.loc.sample
Initializing tool-data/codingSnps.loc from codingSnps.loc.sample
Initializing tool-data/encode_datasets.loc from encode_datasets.loc.sample
Initializing tool-data/faseq.loc from faseq.loc.sample
Initializing tool-data/funDo.loc from funDo.loc.sample
Initializing tool-data/gatk_annotations.txt from gatk_annotations.txt.sample
Initializing tool-data/gatk_sorted_picard_index.loc from
gatk_sorted_picard_index.loc.sample
Initializing tool-data/lastz_seqs.loc from lastz_seqs.loc.sample
Initializing tool-data/liftOver.loc from liftOver.loc.sample
Initializing tool-data/maf_index.loc from maf_index.loc.sample
Initializing tool-data/maf_pairwise.loc from maf_pairwise.loc.sample
Initializing tool-data/microbial_data.loc from microbial_data.loc.sample
Initializing tool-data/mosaik_index.loc from mosaik_index.loc.sample
Initializing tool-data/ngs_sim_fasta.loc from ngs_sim_fasta.loc.sample
Initializing tool-data/perm_base_index.loc from perm_base_index.loc.sample
Initializing tool-data/perm_color_index.loc from perm_color_index.loc.sample
Initializing tool-data/phastOdds.loc from phastOdds.loc.sample
Initializing tool-data/picard_index.loc from picard_index.loc.sample
Initializing tool-data/quality_scores.loc from quality_scores.loc.sample
Initializing tool-data/regions.loc from regions.loc.sample
Initializing tool-data/sam_fa_indices.loc from sam_fa_indices.loc.sample
Initializing tool-data/sequence_index_base.loc from
sequence_index_base.loc.sample
Initializing tool-data/sequence_index_color.loc from
sequence_index_color.loc.sample
Initializing tool-data/sift_db.loc from sift_db.loc.sample
Initializing tool-data/srma_index.loc from srma_index.loc.sample
Initializing tool-data/twobit.loc from twobit.loc.sample
Initializing static/welcome.html from welcome.html.sample
Some eggs are out of date, attempting to fetch...
Fetched 
http://eggs.g2.bx.psu.edu/pysam/pysam-0.4.2_kanwei_b10f6e722e9a-py2.7-linux-x86_64-ucs4.egg
Fetched http://eggs.g2.bx.psu.edu/lrucache/lrucache-0.2-py2.7.egg
Fetched 
http://eggs.g2.bx.psu.edu/sqlalchemy_migrate/sqlalchemy_migrate-0.5.4-py2.7.egg
Fetched http://eggs.g2.bx.psu.edu/pexpect/pexpect-2.4-py2.7.egg
Fetched http://eggs.g2.bx.psu.edu/amqplib/amqplib-0.6.1-py2.7.egg
Fetched 

[galaxy-dev] Set metadata from within the tool

2012-07-17 Thread roberto . dilauro

Hi everyone,
How can I set dataset's metadata from within the tool?
For example: From the command tag (in the xml tool specification) i  
call myscript.sh:

command
myscript.sh -input=$input -output=$output
 /command
My script.sh produce a value that i want to store as metadata of $input.

I've checked the tool config syntax  
http://wiki.g2.bx.psu.edu/Admin/Tools/Tool%20Config%20Syntax and seems  
that i can read metadata (${input.metadata.somemetadata}) but not write.

Maybe code tag can help me but it is deprecated.
Thanks for the help,
 Roberto

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

 http://lists.bx.psu.edu/


Re: [galaxy-dev] Galaxy crach while visualization

2012-07-17 Thread Jeremy Goecks
Hello Amine,

The paster log looks normal, and Postgre log is standard given the crash. Was 
there anything out of the ordinary that you can spot in the paster log and/or 
Javascript log in your Web browser?

Thanks,
J.

On Jul 17, 2012, at 6:53 AM, Chebbi Mohamed Amine wrote:

 Hello Galaxy team !
 
 I have e strange problem whith my Galaxy trackster visualization . While 
 viewing bookmarked regions in my visualisation the whole   
 Galaxy process crashed and needed to be restarted, mainly when I use Chrome 
 browser.
  
 Above the Paster.log :
 
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1183972high=1185154mode=Autoresolution=2.954022988505747dataset_id=f4b17be90d9b3c9dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1182790high=1183972mode=Autoresolution=2.954022988505747dataset_id=ec90add676cb0ccehda_ldda=hdafilter_cols=%5B%22Mapping+Quality%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1181609high=1182791mode=Autoresolution=2.954022988505747dataset_id=ec90add676cb0ccehda_ldda=hdafilter_cols=%5B%22Mapping+Quality%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1183972high=1185154mode=Autoresolution=2.954022988505747dataset_id=ec90add676cb0ccehda_ldda=hdafilter_cols=%5B%22Mapping+Quality%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1180427high=1181609mode=Autoresolution=2.954022988505747dataset_id=cc26e7b927e75a3dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1181609high=1182791mode=Autoresolution=2.954022988505747dataset_id=cc26e7b927e75a3dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) 
 AppleWebKit/536.11 (KHTML, like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:36 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=1182790high=1183972mode=Autoresolution=2.954022988505747dataset_id=cc26e7b927e75a3dhda_ldda=hdafilter_cols=%5B%22Score%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 xxx.xxx.xx.xxx, xxx.xx.xx.x - - [12/Jul/2012:12:56:37 +0200] GET 
 /galaxy/tracks/data?chrom=chr19low=814128high=815310mode=Autoresolution=2.954022988505747dataset_id=7710e7c5028b7c3bhda_ldda=hdafilter_cols=%5B%22Score%22%5D
  HTTP/1.1 200 - 
 http://xxx.xxx.com/galaxy/u/amine/v/rna-seq-analysis-tophats-output; 
 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_4) AppleWebKit/536.11 (KHTML, 
 like Gecko) Chrome/20.0.1132.47 Safari/536.11
 
 PostgreSQL saw the crach :
 
 2012-07-12 12:56:40 CEST LOG:  could not receive data from client: Connection 
 reset by peer
 2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
 2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
 2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:00:46.907 
 user=user database=database host=server port=33106
 2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
 2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
 2012-07-12 12:56:40 CEST LOG:  unexpected EOF on client connection
 2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:03:45.206 
 user=user database=database host=server port=42867
 2012-07-12 12:56:40 CEST LOG:  disconnection: session time: 0:06:43.257 
 user=user database=database host=server port=56383
 2012-07-12 12:56:40 CEST LOG:  disconnection: 

[galaxy-dev] xsendfile permissions

2012-07-17 Thread Julian Pradinuk
Hi all,

I'm wondering if someone who has downloads working through apache (using
xsendfile) has encountered this error when downloading HTML files:

(13)Permission denied: xsendfile: cannot open file:
/galaxy_data/production/tmp/tmpN0ydYt/library_download.zip

The output from ls -lZ /galaxy_data/production/tmp is:
...
drwx--. galaxy galaxy unconfined_u:object_r:httpd_sys_content_t:s0
tmpN0ydYt
...
The output from ls-lZ /galaxy_data/production/tmp/tmpN0ydYt/ is:
-rw-rw-r--. galaxy galaxy unconfined_u:object_r:httpd_sys_content_t:s0
library_download.zip


It's not a SElinux issue (if I sudo setenforce 0, the problem persists)..
It seems it's a regular permissions issue (user apache is running httpd and
does not permission to enter the tmpN0ydYt). Since galaxy creates these
files with these permissions I don't know how to fix this issue. I'm also
wondering why the HTML datasets are in the tmp folder not the files folder?

Here's my apache config:
VirtualHost *:80
ServerName 
RewriteEngine on
#RewriteOptions Inherit
#RewriteLog /etc/httpd/logs/rewrite_log
#RewriteLogLevel 5
RewriteRule ^/galaxy$ /galaxy/ [R]
RewriteRule ^/galaxy/static/style/(.*)
/usr/local/galaxy/production/galaxy-dist/static/june_2007_style/blue/$1 [L]
RewriteRule ^/galaxy/static/scripts/(.*)
/usr/local/galaxy/production/galaxy-dist/static/scripts/packed/$1 [L]
RewriteRule ^/galaxy/static/(.*)
/usr/local/galaxy/production/galaxy-dist/static/$1 [L]
RewriteRule ^/galaxy/favicon.ico
/usr/local/galaxy/production/galaxy-dist/static/favicon.ico [L]
RewriteRule ^/galaxy/robots.txt
/usr/local/galaxy/production/galaxy-dist/static/robots.txt [L]
RewriteRule ^/galaxy(.*) http://localhost:8080$1 [P]

Location /galaxy
order allow,deny
allow from all

# Compress all uncompressed content
SetOutputFilter DEFLATE
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:t?gz|zip|bz2)$ no-gzip dont-vary

# Send files through Apache
XSendFile on
XSendFilePath /galaxy_data
/Location

Location /galaxy/static
# Allow browsers to cache everything from /static for 6 hours
ExpiresActive On
ExpiresDefault access plus 6 hours
/Location
/VirtualHost

Is there something wrong with it? Or have I missed something in
universe.wsgi?



Cheers,

Julian
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

  http://lists.bx.psu.edu/

[galaxy-dev] NTLM auth not passing http_remote_user?

2012-07-17 Thread Smithies, Russell
It appears that NTLM isn't passing the HTTP_REMOTE_USER through for us.
Anyone else struck this and found a solution?

Our apache config looks like this:

Location /
  AuthName Galaxy
  NTLMAuth on
  NTLMAuthHelper /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
  NTLMBasicAuthoritative on
  AuthType NTLM
  require valid-user

# Take the $REMOTE_USER environment variable and set it as a header in the 
proxy request.
  RewriteCond %{IS_SUBREQ} ^false$
  RewriteCond %{LA-U:REMOTE_USER} (.+)
  RewriteRule . - [E=RU:%1]
  RequestHeader set REMOTE_USER %{RU}e

/Location


thanx,

--Russell

CONTENT_LENGTH
'0'
HTTP_ACCEPT
'*/*'
HTTP_ACCEPT_ENCODING
'gzip, deflate'
HTTP_ACCEPT_LANGUAGE
'en-NZ'
HTTP_AUTHORIZATION
'NTLM bla bla bla'
HTTP_CONNECTION
'Keep-Alive'
HTTP_COOKIE
'__utmc=89232139; 
__utma=89232139.1132753487.1341174446.1342136886.1342560287.3; 
__utmz=89232139.1342560287.3.3.utmcsr=gw.agresearch.co.nz|utmccn=(referral)|utmcmd=referral|utmcct=/Pages/Default.aspx;
 __utmb=89232139.4.10.1342560287; galaxysession=c6ca0dd bla bla bla' bla bla 
bla' bla bla bla' bla bla bla' bla bla bla' bla bla bla' bla bla bla' bla bla 
bla' bla bla bla'
HTTP_HOST
'galaxy-dev.agresearch.co.nz'
HTTP_REMOTE_USER
'(null)'
HTTP_USER_AGENT
'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; WOW64; Trident/5.0; SLCC2; 
.NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 
6.0; .NET CLR 1.1.4322; .NET4.0C; .NET4.0E; InfoPath.3)'
HTTP_X_FORWARDED_FOR
'147.158.129.160'
HTTP_X_FORWARDED_HOST
'galaxy-dev.agresearch.co.nz'
HTTP_X_FORWARDED_SERVER
'galaxy.agresearch.co.nz'
ORGINAL_HTTP_HOST
'localhost:8080'
ORGINAL_REMOTE_ADDR
'127.0.0.1'
PATH_INFO
'/'
REMOTE_ADDR
'147.158.129.160'
REQUEST_METHOD
'GET'
SERVER_NAME
'127.0.0.1'
SERVER_PORT
'8080'
SERVER_PROTOCOL
'HTTP/1.1'

===
Attention: The information contained in this message and/or attachments
from AgResearch Limited is intended only for the persons or entities
to which it is addressed and may contain confidential and/or privileged
material. Any review, retransmission, dissemination or other use of, or
taking of any action in reliance upon, this information by persons or
entities other than the intended recipients is prohibited by AgResearch
Limited. If you have received this message in error, please notify the
sender immediately.
===

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

  http://lists.bx.psu.edu/


Re: [galaxy-dev] NTLM auth not passing http_remote_user?

2012-07-17 Thread Assaf Gordon
Hello Russell,

Smithies, Russell wrote, On 07/17/2012 05:41 PM:
 It appears that NTLM isn't passing the HTTP_REMOTE_USER through for us.
 Anyone else struck this and found a solution?
 
 Our apache config looks like this:
 
 Location /
   AuthName Galaxy
   NTLMAuth on
   NTLMAuthHelper /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
   NTLMBasicAuthoritative on
   AuthType NTLM
   require valid-user
 
 # Take the $REMOTE_USER environment variable and set it as a header in 
 the proxy request.
   RewriteCond %{IS_SUBREQ} ^false$
   RewriteCond %{LA-U:REMOTE_USER} (.+)
   RewriteRule . - [E=RU:%1]
   RequestHeader set REMOTE_USER %{RU}e
 
 /Location

snip

 HTTP_REMOTE_USER
 '(null)'


One voodoo solution that worked for me (not with NTLM, but exactly with the 
same '(null)' symptom)
is to take the entire RewriteCond part outside of the Location block.
Put it in the global configuration file, after the Location part, but before 
the proxy statement.

Also, the exact incantation that worked for me (after many many trials and 
errors) is:
===
RewriteRule . - [E=RU:%{LA-U:REMOTE_USER}]
RequestHeader set REMOTE_USER %{RU}e
===

It's voodoo (to me) because it probably has something to do with deep apache 
internals, relating to execution order of the authentication module vs the 
mod_rewrite parts (and the LA-U [Look-ahead] thing sure doesn't help to 
make it clearer...).

-gordon


___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

  http://lists.bx.psu.edu/


[galaxy-dev] Attempting to use parallelism in BWA

2012-07-17 Thread Jennifer Jackson
To give this question better visibility, I am going to move it over to 
the galaxy-...@bx.psu.edu mailing list.


Thanks!

Jen
Galaxy team

fwd from galaxy-user

On 7/17/12 11:31 AM, Scott McManus wrote:

Hi Kevin-

That's truly odd. The error happens when the offending file is imported,
which means that
it is a syntax issue that should have been seen earlier. I'll take a
look at this soon (unless someone
else beats me to it).

In the meantime, of course, do not use the use_tasked_jobs on this
instance of Galaxy. If others
have seen similar issues, then please speak up.

-Scott



Hi,

I am using Python 2.7. I am running with an hg checked out, up to
date version of https://bitbucket.org/galaxy/galaxy-dist/;.

I am very new to Galaxy. I have an instance setup *and
running* locally. I am able to perform routine actions such as
uploading files, processing with Picard, and aligning with BWA. I
have been able to make the jobs execute out our SGE cluster.

In order to better utilize my cluster, I attempted to enable
parallelism of the tasks that support it (such as BWA) by
configuring the *universe_wsgi.ini* file with the parameter

use_tasked_jobs = True

When I do this and attempt execute a BWA alignment on a 4.1Gb fastq
file, I am given the error


Result 256 from mv

/pbtech_mounts/fclab_store006/gobyweb_dat/galaxy-python/database/job_working_directory/000/21/task_1/dataset_21.dat

/pbtech_mounts/fclab_store006/gobyweb_dat/galaxy-python/database/files/000/dataset_21.dat

/pbtech_mounts/fclab_store006/gobyweb_dat/galaxy-python/database/job_working_directory/000/21/task_0:
Traceback (most recent call last):
   File ./scripts/extract_dataset_part.py, line 25, in ?
 import galaxy.model.mapping #need to load this before we
unpickle, in order to setup properties assigned by the mappers
   File

/pbtech_mounts/fclab_store006/gobyweb_dat/galaxy-python/lib/galaxy/model/__init__.py,
line 13, in ?
 import galaxy.datatypes.registry
   File

/pbtech_mounts/fclab_store006/gobyweb_dat/galaxy-python/lib/galaxy/datatypes/registry.py,
line 146
 finally:
   ^
SyntaxError: invalid syntax
The alignment failed.


If you need the complete error message, contact me and I can supply
you with it. It's too large to paste in-line and attachments aren't
allowed.

Is there more I need to do to enable parallel jobs (splitting of
input, align, then merge)?

Any suggestions are greatly appreciated.

Kevin

___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

   http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

   http://lists.bx.psu.edu/




___
The Galaxy User list should be used for the discussion of
Galaxy analysis and other features on the public server
at usegalaxy.org.  Please keep all replies on the list by
using reply all in your mail client.  For discussion of
local Galaxy instances and the Galaxy source code, please
use the Galaxy Development list:

   http://lists.bx.psu.edu/listinfo/galaxy-dev

To manage your subscriptions to this and other Galaxy lists,
please use the interface at:

   http://lists.bx.psu.edu/



--
Jennifer Jackson
http://galaxyproject.org


___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

 http://lists.bx.psu.edu/


Re: [galaxy-dev] NTLM auth not passing http_remote_user?

2012-07-17 Thread Smithies, Russell
If I take the rewrite out of the location block then NTLM auth fails as the 
username is re-written and isn't a valid corporate username.
On the plus side, If I just set RequestHeader set REMOTE_USER smithiesr  then 
I get logged in as I should.

--Russell


-Original Message-
From: Assaf Gordon [mailto:gor...@cshl.edu] 
Sent: Wednesday, 18 July 2012 9:59 a.m.
To: Smithies, Russell
Cc: galaxy-dev@lists.bx.psu.edu
Subject: Re: [galaxy-dev] NTLM auth not passing http_remote_user?

Hello Russell,

Smithies, Russell wrote, On 07/17/2012 05:41 PM:
 It appears that NTLM isn't passing the HTTP_REMOTE_USER through for us.
 Anyone else struck this and found a solution?
 
 Our apache config looks like this:
 
 Location /
   AuthName Galaxy
   NTLMAuth on
   NTLMAuthHelper /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
   NTLMBasicAuthoritative on
   AuthType NTLM
   require valid-user
 
 # Take the $REMOTE_USER environment variable and set it as a header in 
 the proxy request.
   RewriteCond %{IS_SUBREQ} ^false$
   RewriteCond %{LA-U:REMOTE_USER} (.+)
   RewriteRule . - [E=RU:%1]
   RequestHeader set REMOTE_USER %{RU}e
 
 /Location

snip

 HTTP_REMOTE_USER
 '(null)'


One voodoo solution that worked for me (not with NTLM, but exactly with the 
same '(null)' symptom) is to take the entire RewriteCond part outside of the 
Location block.
Put it in the global configuration file, after the Location part, but before 
the proxy statement.

Also, the exact incantation that worked for me (after many many trials and 
errors) is:
===
RewriteRule . - [E=RU:%{LA-U:REMOTE_USER}] RequestHeader set REMOTE_USER %{RU}e 
===

It's voodoo (to me) because it probably has something to do with deep apache 
internals, relating to execution order of the authentication module vs the 
mod_rewrite parts (and the LA-U [Look-ahead] thing sure doesn't help to 
make it clearer...).

-gordon


===
Attention: The information contained in this message and/or attachments
from AgResearch Limited is intended only for the persons or entities
to which it is addressed and may contain confidential and/or privileged
material. Any review, retransmission, dissemination or other use of, or
taking of any action in reliance upon, this information by persons or
entities other than the intended recipients is prohibited by AgResearch
Limited. If you have received this message in error, please notify the
sender immediately.
===

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

  http://lists.bx.psu.edu/


Re: [galaxy-dev] NTLM auth not passing http_remote_user?

2012-07-17 Thread Smithies, Russell
Working now :- )
I blame lack of coffee - I hadn't set RewriteEngine on before I re-wrote the 
request header.
It appears it needs to be in the location section or your initial ntlm auth 
wil fail.

Location /
  AuthName Galaxy
  NTLMAuth on
  NTLMAuthHelper /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
  NTLMBasicAuthoritative on
  AuthType NTLM
  require valid-user

# Take the $REMOTE_USER environment variable, trim the realm and set it as 
a header in the proxy request.
  RewriteEngine on
  RewriteCond %{IS_SUBREQ} ^false$
  RewriteCond %{LA-U:REMOTE_USER} .+\\(.+)
  RewriteRule . - [E=RU:%1]
  RequestHeader set REMOTE_USER %{RU}e

/Location


--Russell

-Original Message-
From: galaxy-dev-boun...@lists.bx.psu.edu 
[mailto:galaxy-dev-boun...@lists.bx.psu.edu] On Behalf Of Smithies, Russell
Sent: Wednesday, 18 July 2012 10:52 a.m.
To: Assaf Gordon
Cc: galaxy-dev@lists.bx.psu.edu
Subject: Re: [galaxy-dev] NTLM auth not passing http_remote_user?

If I take the rewrite out of the location block then NTLM auth fails as the 
username is re-written and isn't a valid corporate username.
On the plus side, If I just set RequestHeader set REMOTE_USER smithiesr  then 
I get logged in as I should.

--Russell


-Original Message-
From: Assaf Gordon [mailto:gor...@cshl.edu]
Sent: Wednesday, 18 July 2012 9:59 a.m.
To: Smithies, Russell
Cc: galaxy-dev@lists.bx.psu.edu
Subject: Re: [galaxy-dev] NTLM auth not passing http_remote_user?

Hello Russell,

Smithies, Russell wrote, On 07/17/2012 05:41 PM:
 It appears that NTLM isn't passing the HTTP_REMOTE_USER through for us.
 Anyone else struck this and found a solution?
 
 Our apache config looks like this:
 
 Location /
   AuthName Galaxy
   NTLMAuth on
   NTLMAuthHelper /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
   NTLMBasicAuthoritative on
   AuthType NTLM
   require valid-user
 
 # Take the $REMOTE_USER environment variable and set it as a header in 
 the proxy request.
   RewriteCond %{IS_SUBREQ} ^false$
   RewriteCond %{LA-U:REMOTE_USER} (.+)
   RewriteRule . - [E=RU:%1]
   RequestHeader set REMOTE_USER %{RU}e
 
 /Location

snip

 HTTP_REMOTE_USER
 '(null)'


One voodoo solution that worked for me (not with NTLM, but exactly with the 
same '(null)' symptom) is to take the entire RewriteCond part outside of the 
Location block.
Put it in the global configuration file, after the Location part, but before 
the proxy statement.

Also, the exact incantation that worked for me (after many many trials and 
errors) is:
===
RewriteRule . - [E=RU:%{LA-U:REMOTE_USER}] RequestHeader set REMOTE_USER %{RU}e 
===

It's voodoo (to me) because it probably has something to do with deep apache 
internals, relating to execution order of the authentication module vs the 
mod_rewrite parts (and the LA-U [Look-ahead] thing sure doesn't help to 
make it clearer...).

-gordon


===
Attention: The information contained in this message and/or attachments from 
AgResearch Limited is intended only for the persons or entities to which it is 
addressed and may contain confidential and/or privileged material. Any review, 
retransmission, dissemination or other use of, or taking of any action in 
reliance upon, this information by persons or entities other than the intended 
recipients is prohibited by AgResearch Limited. If you have received this 
message in error, please notify the sender immediately.
===

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this and other Galaxy 
lists, please use the interface at:

  http://lists.bx.psu.edu/

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:

  http://lists.bx.psu.edu/