Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
Il giorno mar, 19/03/2013 alle 15.20 -0400, Raj Ayyampalayam ha scritto: One of the first few tools I tested was the ncbi makebkastdb tool. When I try to run it the history for that particular job is immediately shown as follows: 0: (unnamed dataset) Failed to retrieve dataset information. An error occurred with this dataset:/hasattr(): attribute name must be string/ Hi Raj, this error in the history should be fixed by this patch: https://bitbucket.org/nsoranzo/peterjc-galaxy-central-tools2/commits/35163cbc6c694f598ed1a1875353c58b275e2423 I have sent a pull request to Peter (the maintainer), hopefully he will release soon a new version of blast_datatypes with this fix. Best, Nicola ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
On Wed, Mar 20, 2013 at 10:08 AM, Nicola Soranzo sora...@crs4.it wrote: Il giorno mar, 19/03/2013 alle 15.20 -0400, Raj Ayyampalayam ha scritto: One of the first few tools I tested was the ncbi makebkastdb tool. When I try to run it the history for that particular job is immediately shown as follows: 0: (unnamed dataset) Failed to retrieve dataset information. An error occurred with this dataset:/hasattr(): attribute name must be string/ Hi Raj, this error in the history should be fixed by this patch: https://bitbucket.org/nsoranzo/peterjc-galaxy-central-tools2/commits/35163cbc6c694f598ed1a1875353c58b275e2423 I have sent a pull request to Peter (the maintainer), hopefully he will release soon a new version of blast_datatypes with this fix. Best, Nicola The patch just removes the MetadataElement call - is that wise? Looking at the code, I don't see a recent API change regarding the name: https://bitbucket.org/galaxy/galaxy-central/history-node/default/lib/galaxy/datatypes/metadata.py?at=default Is there perhaps a universe_wsgi.ini setting which might be involved, since I've not seen this error locally? Peter ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
Il giorno mer, 20/03/2013 alle 12.41 +, Peter Cock ha scritto:
On Wed, Mar 20, 2013 at 10:08 AM, Nicola Soranzo sora...@crs4.it wrote:
Il giorno mar, 19/03/2013 alle 15.20 -0400, Raj Ayyampalayam ha
scritto:
One of the first few tools I tested was the ncbi makebkastdb tool. When
I try to run it the history for that particular job is immediately shown
as follows:
0: (unnamed dataset)
Failed to retrieve dataset information.
An error occurred with this dataset:/hasattr(): attribute name must be
string/
Hi Raj,
this error in the history should be fixed by this patch:
https://bitbucket.org/nsoranzo/peterjc-galaxy-central-tools2/commits/35163cbc6c694f598ed1a1875353c58b275e2423
I have sent a pull request to Peter (the maintainer), hopefully he will
release soon a new version of blast_datatypes with this fix.
Best,
Nicola
The patch just removes the MetadataElement call - is that wise?
Hi Peter,
my question instead is, what are they for? With 'name' they have no
meaning.
Looking at the code, I don't see a recent API change regarding
the name:
https://bitbucket.org/galaxy/galaxy-central/history-node/default/lib/galaxy/datatypes/metadata.py?at=default
Is there perhaps a universe_wsgi.ini setting which might be involved,
since I've not seen this error locally?
$ cd lib/galaxy/datatypes/
$ grep 'MetadataElement(' *.py|grep -v name
returns nothing, so the 'name' parameter is really mandatory.
Best,
Nicola
___
Please keep all replies on the list by using reply all
in your mail client. To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
http://lists.bx.psu.edu/
Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
On Wed, Mar 20, 2013 at 1:55 PM, Peter Cock p.j.a.c...@googlemail.com wrote:
On Wed, Mar 20, 2013 at 1:52 PM, Nicola Soranzo sora...@crs4.it wrote:
Il giorno mer, 20/03/2013 alle 12.41 +, Peter Cock ha scritto:
The patch just removes the MetadataElement call - is that wise?
Hi Peter,
my question instead is, what are they for? With 'name' they have no
meaning.
Looking at the code, I don't see a recent API change regarding
the name:
https://bitbucket.org/galaxy/galaxy-central/history-node/default/lib/galaxy/datatypes/metadata.py?at=default
Is there perhaps a universe_wsgi.ini setting which might be involved,
since I've not seen this error locally?
$ cd lib/galaxy/datatypes/
$ grep 'MetadataElement(' *.py|grep -v name
returns nothing, so the 'name' parameter is really mandatory.
Best,
Nicola
Good question - I'd have to ask Edward what he thought this did,
but you seem to be right that as the code stands this metadata
element is rather pointless.
(I'm still puzzled why we don't see the error here though).
I'll apply your patch and test it locally...
Peter
Nicola - It looks good here, uploaded to the ToolShed as v0.0.15
http://toolshed.g2.bx.psu.edu/view/devteam/blast_datatypes
Raj - Could you apply the update from the ToolShed and
confirm if that fixes the problem for you?
Edward - have you received my direct email off list?
Thanks,
Peter
___
Please keep all replies on the list by using reply all
in your mail client. To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
http://lists.bx.psu.edu/
Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
Hi Guys,
Thanks for the quick response. I installed the latest blast datatypes
from the toolshed and that fixed the issue.
Peter, can you also fix the $outfile.extra_files_path to
$outfile.files_path on line 5 in the makedb wrapper xml file.
Thanks,
-Raj
On Wednesday, March 20, 2013 10:42:43 AM, Peter Cock wrote:
On Wed, Mar 20, 2013 at 1:55 PM, Peter Cock p.j.a.c...@googlemail.com wrote:
On Wed, Mar 20, 2013 at 1:52 PM, Nicola Soranzo sora...@crs4.it wrote:
Il giorno mer, 20/03/2013 alle 12.41 +, Peter Cock ha scritto:
The patch just removes the MetadataElement call - is that wise?
Hi Peter,
my question instead is, what are they for? With 'name' they have no
meaning.
Looking at the code, I don't see a recent API change regarding
the name:
https://bitbucket.org/galaxy/galaxy-central/history-node/default/lib/galaxy/datatypes/metadata.py?at=default
Is there perhaps a universe_wsgi.ini setting which might be involved,
since I've not seen this error locally?
$ cd lib/galaxy/datatypes/
$ grep 'MetadataElement(' *.py|grep -v name
returns nothing, so the 'name' parameter is really mandatory.
Best,
Nicola
Good question - I'd have to ask Edward what he thought this did,
but you seem to be right that as the code stands this metadata
element is rather pointless.
(I'm still puzzled why we don't see the error here though).
I'll apply your patch and test it locally...
Peter
Nicola - It looks good here, uploaded to the ToolShed as v0.0.15
http://toolshed.g2.bx.psu.edu/view/devteam/blast_datatypes
Raj - Could you apply the update from the ToolShed and
confirm if that fixes the problem for you?
Edward - have you received my direct email off list?
Thanks,
Peter
--
Bio-informatics consultant
QBCG (http://qbcg.uga.edu)
706-542-6092
706-583-0442
___
Please keep all replies on the list by using reply all
in your mail client. To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
http://lists.bx.psu.edu/
Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
On Wed, Mar 20, 2013 at 3:43 PM, Raj Ayyampalayam ra...@uga.edu wrote: Hi Guys, Thanks for the quick response. I installed the latest blast datatypes from the toolshed and that fixed the issue. Great - thanks for letting us know so promptly. Peter, can you also fix the $outfile.extra_files_path to $outfile.files_path on line 5 in the makedb wrapper xml file. What do you mean 'fix' it? It should be using extra_files_path shouldn't it? This is a composite datatype in Galaxy. Peter ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
On Wed, Mar 20, 2013 at 3:47 PM, Peter Cock p.j.a.c...@googlemail.com wrote: On Wed, Mar 20, 2013 at 3:43 PM, Raj Ayyampalayam ra...@uga.edu wrote: Hi Guys, Thanks for the quick response. I installed the latest blast datatypes from the toolshed and that fixed the issue. Great - thanks for letting us know so promptly. Peter, can you also fix the $outfile.extra_files_path to $outfile.files_path on line 5 in the makedb wrapper xml file. What do you mean 'fix' it? It should be using extra_files_path shouldn't it? This is a composite datatype in Galaxy. Are you perhaps running jobs as real user? That might explain when this difference is important: http://lists.bx.psu.edu/pipermail/galaxy-dev/2012-April/009579.html http://lists.bx.psu.edu/pipermail/galaxy-dev/2013-March/013889.html Thanks, Peter ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
[galaxy-dev] Problem running ncbi_makeblastdb as real user in cluster
Hello, I am setting up a local galaxy installation and using our local SGE cluster to run the jobs as real users. One of the first few tools I tested was the ncbi makebkastdb tool. When I try to run it the history for that particular job is immediately shown as follows: 0: (unnamed dataset) Failed to retrieve dataset information. An error occurred with this dataset:/hasattr(): attribute name must be string/ In the stdout of the job I was getting the following error: Fatal error: Matched on Error: Error: NCBI C++ Exception: /usr/local/src/ncbiblast+/2.2.27/c++/src/objtools/blast/seqdb_writer/build_db.cpp, line 979: Error: ncbi::s_CreateDirectories() - Failed to create directory 'dataset_38_files' I finally figured out that the makedb wrapper was using $outfile.extra_files_path instead of $outfile.files_path. I fixed the wrapper and restarted the instance. The job now runs ok and reports successful completion in the stdout. But, the history for this particular job is still shown as explained above. Can somebody help me figure out what is going wrong in my setup? Here are some of the relevant logs: == web1.log == 128.192.203.31 - - [19/Mar/2013:15:14:35 -0400] POST /tool_runner/index HTTP/1.1 200 - http://galaxy.qbcg.uga.edu/tool_runner?tool_id=toolshed.g2.bx.psu.edu/repos/devteam/ncbi_blast_plus/ncbi_makeblastdb/0.0.1; Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.22 (KHTML, like Gecko) Chrome/25.0.1364.172 Safari/537.22 == web0.log == 128.192.203.31 - - [19/Mar/2013:15:14:36 -0400] GET /history HTTP/1.1 200 - http://galaxy.qbcg.uga.edu/tool_runner/index; Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.22 (KHTML, like Gecko) Chrome/25.0.1364.172 Safari/537.22 galaxy.webapps.galaxy.api.history_contents ERROR 2013-03-19 15:14:36,161 Error in history API at listing contents with history d413a19dec13d11e, hda e89067bb68bee7a0: hasattr(): attribute name must be string galaxy.webapps.galaxy.api.history_contents ERROR 2013-03-19 15:14:36,316 Error in history API at listing contents with history d413a19dec13d11e, hda ba03619785539f8c: hasattr(): attribute name must be string galaxy.webapps.galaxy.api.history_contents ERROR 2013-03-19 15:14:36,316 Error in history API at listing contents with history d413a19dec13d11e, hda cbbbf59e8f08c98c: hasattr(): attribute name must be string galaxy.webapps.galaxy.api.history_contents ERROR 2013-03-19 15:14:36,317 Error in history API at listing contents with history d413a19dec13d11e, hda 964b37715ec9bd22: hasattr(): attribute name must be string galaxy.webapps.galaxy.api.history_contents ERROR 2013-03-19 15:14:36,317 Error in history API at listing contents with history d413a19dec13d11e, hda 1fad1eaf5f4f1766: hasattr(): attribute name must be string galaxy.webapps.galaxy.api.history_contents ERROR 2013-03-19 15:14:36,318 Error in history API at listing contents with history d413a19dec13d11e, hda 2fdbd5c5858e78fb: hasattr(): attribute name must be string == manager.log == galaxy.jobs.manager DEBUG 2013-03-19 15:14:40,856 (42) Job assigned to handler 'handler0' == handler0.log == galaxy.jobs DEBUG 2013-03-19 15:14:41,790 (42) Working directory for job is: /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/job_working_directory/000/42 galaxy.jobs.rules.200_rules DEBUG 2013-03-19 15:14:41,791 toolshed.g2.bx.psu.edu/repos/devteam/ncbi_blast_plus/ncbi_makeblastdb/0.0.1 galaxy.jobs.handler DEBUG 2013-03-19 15:14:41,792 dispatching job 42 to drmaa runner galaxy.jobs.handler INFO 2013-03-19 15:14:41,882 (42) Job dispatched galaxy.tools DEBUG 2013-03-19 15:14:42,068 Building dependency shell command for dependency 'makeblastdb' galaxy.tools WARNING 2013-03-19 15:14:42,068 Failed to resolve dependency on 'makeblastdb', ignoring galaxy.jobs.runners.drmaa DEBUG 2013-03-19 15:14:42,453 (42) submitting file /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/pbs/galaxy_42.sh galaxy.jobs.runners.drmaa DEBUG 2013-03-19 15:14:42,453 (42) command is: makeblastdb -version /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/tmp/GALAXY_VERSION_STRING_42; makeblastdb -out /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/job_working_directory/000/42/dataset_41_files/blastdb -hash_index -in /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/files/000/dataset_30.dat -title wert -dbtype nucl; cd /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist; /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/set_metadata.sh ./database/files /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/job_working_directory/000/42 . /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/universe_wsgi.ini /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/tmp/tmpxi116L /panfs/pstor.storage/home/qbcglab/galaxy_run/galaxy-dist/database/job_working_directory/000/42/galaxy.json
