Re: [galaxy-dev] Error in creating admin user during tool shed bootstrap

2014-11-13 Thread Will Holtz
I successfully did the tool shed bootstrapping with postgresql once. But
beyond that, I don't think I can offer much advice.

-Will


On Thu, Nov 13, 2014 at 7:41 AM, John Chilton jmchil...@gmail.com wrote:

 Hey Bruno,

   So Greg has moved on new exciting things and I am not sure if there
 is anyone who now routinely does the tool shed bootstrapping workflow
 that can help.

   I tried the bootstrapping process and it worked fine with an sqlite
 database - maybe it is not compatible with postgres? Want to try
 sqlite instead - should be fine for testing?

 -John


 On Mon, Nov 10, 2014 at 3:42 PM, Bruno Grande bgra...@sfu.ca wrote:
  I had the brilliant idea of sending the previous email out on a Friday
  afternoon/evening. I'm just following up with this thread.
 
  Best regards,
  Bruno
 
  --
  Bruno Grande, B.Sc. (Hons)
  M.Sc. Candidate
  Dr. Ryan Morin's Laboratory
  Molecular Biology and Biochemistry, Simon Fraser University
  SSB7133,  University Drive, Burnaby, BC, Canada, V5A 1S6
 
  On Fri, Nov 7, 2014 at 2:17 PM, Bruno Grande bgra...@sfu.ca wrote:
 
  I'm setting up a local development Tool Shed according to Greg Von
  Kuster's blog post. During the bootstrapping process, it seems that the
  creation of the admin user based on the information in user_info.xml
 fails
  because of a SQLAlchemy error (see attached stdout.txt). As a result, I
  believe the API calls for creating categories and users also fail,
 because
  they depend on the existence of admin user.
 
  This error seems to be due to a missing repository table in the
 database.
  I ran the SQL query against the Tool Shed database within PostgreSQL
 after
  the failed bootstrapping command and it returned no error, because the
  repository table actually exists.
 
  So, I don't know whether the SQL query is being run against the wrong
  database (e.g. the Galaxy database) or if the database schema isn't
 properly
  set up by the time SQLAlchemy attempts the query.
 
  I'm using the latest version of Galaxy (revision 83f821c5ecc1).
 
  Best regards,
  Bruno
 
 
 
  ___
  Please keep all replies on the list by using reply all
  in your mail client.  To manage your subscriptions to this
  and other Galaxy lists, please use the interface at:
http://lists.bx.psu.edu/
 
  To search Galaxy mailing lists use the unified search at:
http://galaxyproject.org/search/mailinglists/
 ___
 Please keep all replies on the list by using reply all
 in your mail client.  To manage your subscriptions to this
 and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/

 To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/




-- 
The information contained in this e-mail message or any attachment(s) may
be confidential and/or privileged and is intended for use only by the
individual(s) to whom this message is addressed.  If you are not the
intended recipient, any dissemination, distribution, copying, or use is
strictly prohibited.  If you receive this e-mail message in error, please
e-mail the sender at who...@lygos.com and destroy this message and remove
the transmission from all computer directories (including e-mail servers).

Please consider the environment before printing this email.
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-dev] Login with a system user

2014-10-01 Thread Will Holtz
This should be possible with Apache as the proxy and the mod_auth_pam
Apache module. From a high level, the configuration should be similar to
using mod_authnz_ldap or mod_auth_kerb as documented here:
https://wiki.galaxyproject.org/Admin/Config/ExternalUserDatbases

-Will


On Wed, Oct 1, 2014 at 10:03 AM, John Chilton jmchil...@gmail.com wrote:

 I don't know how one would do this precisely but I believe it is
 possible at the proxy level - i.e. setting up Apache to handle this
 and authenticate with system resources. I believe Tim Booth's work on
 integrating galaxy into biolinux uses system users for authentication
 by default.

 The following thread has more discussion on that:
 http://lists.bx.psu.edu/pipermail/galaxy-dev/2014-March/018770.html

 More generic information on configuring an Apache Proxy can be found here:
 https://wiki.galaxyproject.org/Admin/Config/ApacheProxy

 Hope this helps.

 -John

 On Tue, Sep 30, 2014 at 9:22 AM, Daniel Ruiz Molina
 daniel.r...@aomail.uab.es wrote:
  Hello,
 
  I have configured Galaxy, but I would be very interested in configure it
  with PAM or /etc/passwd (/etc/shadow) instead of creating a user in the
 web
  interface.
  How can I configure Galaxy for authenticating with system files?
 
  Thanks.
  ___
  Please keep all replies on the list by using reply all
  in your mail client.  To manage your subscriptions to this
  and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/
 
  To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/
 ___
 Please keep all replies on the list by using reply all
 in your mail client.  To manage your subscriptions to this
 and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/

 To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/




-- 
The information contained in this e-mail message or any attachment(s) may
be confidential and/or privileged and is intended for use only by the
individual(s) to whom this message is addressed.  If you are not the
intended recipient, any dissemination, distribution, copying, or use is
strictly prohibited.  If you receive this e-mail message in error, please
e-mail the sender at who...@lygos.com and destroy this message and remove
the transmission from all computer directories (including e-mail servers).

Please consider the environment before printing this email.
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-dev] problems installing tool dependency

2014-09-24 Thread Will Holtz
I also was able to download quicktree.tar.gz by clicking on the URL in your
message. However, when I manually ftp into ftp.sanger.ac.uk, there is no
/pub4 directory. I'm a bit confused about how those two statements are both
true, but maybe it will help someone else figure this out. Removing the '4'
does result in a valid path (
ftp://ftp.sanger.ac.uk/pub/resources/software/quicktree/quicktree.tar.gz).

-Will

On Wed, Sep 24, 2014 at 10:57 AM, Sajdak, Doris dj...@buffalo.edu wrote:

  Hi all,



 I am trying to install the Genome Diversity tools from the Miller Lab that
 are in the Galaxy toolshed.  I’ve been able to get all dependencies
 installed except Quicktree.  Whenever I try to install it, I get the error:



 Error downloading from URL

 ftp://ftp.sanger.ac.uk/pub4/resources/software/quicktree/quicktree.tar.gz:

 urlopen error ftp error: 550 pub4: No such file or directory



 This is the tool_dependencies.xml file for installing quicktree:



 ?xml version=1.0?

 tool_dependency

   package name=quicktree version=1.1

 install version=1.0

   actions

 !-- Download source code --

 action type=download_by_url
 target_filename=quicktree_1.1.tar.gz
 ftp://ftp.sanger.ac.uk/pub4/resources/software/quicktree/quicktree.tar.gz
 /action



 !-- Build quicktree --

 action type=shell_commandmake quicktree/action



 !-- Install quicktree --

 action type=shell_commandcp -R bin $INSTALL_DIR/action



 !-- Set environment for dependent repositories --

 action type=set_environment

   environment_variable name=PATH
 action=prepend_to$INSTALL_DIR/bin/environment_variable

 /action

   /actions

 /install

   /package

 /tool_dependency





 I know this is not their file I’m downloading but the thing is, if I copy
 and paste the URL, I can download it with no problem.  I’m not sure why
 it’s reporting that it can’t be found but the xml looks right to me.  I’ve
 tried contacting the Miller Lab about this but haven’t heard from anyone so
 I’m hoping someone here can tell me how to move past this problem.  Is
 there a way to install this tool manually and have the main Genome
 Diversity tools recognize it on the Galaxy server?



 Also, I noticed when looking at the Tool Dependency Definitions at
 https://toolshed.g2.bx.psu.edu/ there are errors going back many versions
 for this tool (see Test runs – Installation errors – Tool dependencies).



 Thank you for any help you can provide.



 Dori



 **

 Dori Sajdak

 Senior Systems Administrator

 State University of NY at Buffalo

 Center for Computational Research

 701 Ellicott St

 Buffalo, NY 14203

 Phone: (716) 881-8934

 Fax: (716) 849-6656

 Web: http://ccr.buffalo.edu

 **







 ___
 Please keep all replies on the list by using reply all
 in your mail client.  To manage your subscriptions to this
 and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/

 To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

[galaxy-dev] interpreter option for version_command tag

2014-06-19 Thread Will Holtz
The documentation for the version_command tag doesn't mention it can take
an interpreter option:
https://wiki.galaxyproject.org/Admin/Tools/ToolConfigSyntax#A.3Cversion_command.3E_tag_set

I looked at the code in lib/galaxy/tools/__init__.py to see how this was
implemented. I was surprised to see that if the interpreter option is
passed to version_command, then the interpreter value from the command tag
is used in generating the version number response. The version_command
interpreter value is never used. For example, I tried the following:

version_command interpreter=foobarmyPythonTool -v/version_command

command interpreter=pythonmyPythonTool someCheetahCode/command

And Galaxy successfully got the version number. Is this the expected
behavior?

-Will
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-dev] Postgresql database time wrong...

2014-06-18 Thread Will Holtz
Hmm. You are probably very similar to my setup (ubuntu 12.04, Postgres
9.1), and my Postgres install did manage to use the system timezone. I
would check two things:
1) /etc/timezone
2) run psql and execute 'show timezone;'
If those values look reasonable, then I'm out of suggestions.

-Will


On Tue, Jun 17, 2014 at 8:12 PM, neil.burd...@csiro.au wrote:

  Thanks, but looking at /etc/postgresql/9.1/main/postgresql.conf i have
 the following:
 #timezone = '(defaults to server environment setting)'
 #timezone_abbreviations = 'Default' # Select the set of available time
 zone
 # abbreviations.  Currently, there
 are
 #   Default
 #   Australia
 #   India
 # You can create your own file in
 # share/timezonesets/.

 So i assume it should get the time from the ubuntu machine it runs on. I
 have not done any configuration to the postgresql database. Only installing
 it.

 Neil
  --
 *From:* Will Holtz [who...@lygos.com]
 *Sent:* Wednesday, June 18, 2014 10:25 AM
 *To:* Burdett, Neil (CCI, Herston - RBWH)
 *Cc:* galaxy-dev@lists.bx.psu.edu
 *Subject:* Re: [galaxy-dev] Postgresql database time wrong...

   Postgres generally stores datatime fields in GMT, and then translates
 them to the local time zone when generating a query. Check the TimeZone
 variable in your postgres.conf.


 http://www.postgresql.org/docs/9.3/static/datatype-datetime.html#DATATYPE-TIMEZONES

  -Will


 On Tue, Jun 17, 2014 at 4:29 PM, neil.burd...@csiro.au wrote:

  Hi
I have quite a strange issue. I have a local install of Galaxy setup.
 When I type 'date' on my Ubuntu machine I get something like:

 Wed Jun 18 09:25:22 EST 2014

 When i then execute a job and look in the database at the create_time i.e.

 # select create_time from job order by create_time;

 I get

 2014-06-17 23:20:00.133828

 So about 10 hours different. Is there some configuration I need to set as
 Brisbane is 10hrs ahead of GMT (coincidence?)

 Thanks
 Neil

 ___
 Please keep all replies on the list by using reply all
 in your mail client.  To manage your subscriptions to this
 and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/

 To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/



___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-dev] Import of Capsules failing on local toolshed instance

2014-06-18 Thread Will Holtz
Hi Greg,

I used the toolshed bootstrapping script and was able to get capsules from
testtoolshed to import. Here are a couple of notes that you may find
interesting.

1) In a few places you reference the directory
~/lib/tool_shed/scripts/api/bootstrap_from_toolshed/ and these should be
changed to ~/lib/tool_shed/scripts/bootstrap_from_toolshed/
2) I was worried that 'use_remote_user=True' was going to negatively impact
the bootstrap process, as accounts are being created that don't exist in
LDAP. However, there didn't appear to be any such negative interaction. In
user_info.xml I used my email address that maps to my LDAP login (
who...@lygos.com), a long gibberish password, and wholtz for my username.

Thank you for your help Greg.

-Will


On Tue, Jun 17, 2014 at 7:51 PM, Greg Von Kuster g...@bx.psu.edu wrote:

 Hello Will,

 On Jun 17, 2014, at 6:06 PM, Will Holtz who...@lygos.com wrote:

 It looks like Dave fixed this issue in 4c58aa19a3d7. Thank you!

 However I am still having import issues. I am now getting the message:
 Archive of repository package_bowtie_0_12_7 owned by devteam
 Import failed: repository owner devteam does not have an account in this
 Tool Shed.
 This is on a local toolshed running 9b78595ec11 where I am performing the
 input from an admin account. I'm guessing the issue is that I have
 'use_remote_user=True' for LDAP authentication and that means that a
 devteam account cannot be automatically created to allow this capsule to be
 added without modification.


 Sorry you're still running into problems.  No regular development or
 testing is done using the use_remote_user setting due to resource
 limitations.


 Perhaps on import of a capsule (by an administrator) they could be given
 the option of preserving the existing owners or re-assigning ownership to
 an existing user (defaulting to self)?


 This would be non-trivial, and probably would introduce fragility into the
 process.  However, I believe there is a solution (see my next comment)
 although I haven't tested it with the use_remote_user setting.


 Of course, what I really want is inter-toolshed dependancies. Maybe I'm
 missing something, but I'm finding it quite painful just to get a tool
 development environment setup that makes use of any existing repositories.


 There was some work done in this area in the June 2, 2014 release.  Here
 is some information for more easily setting up a local development Tool
 Shed that use new features introduced in the release.  Hopefully this will
 help.

 Greg Von Kuster
 Bootstrapping a New Development Tool Shed

 The June 2, 2014 release introduces the ability to easily bootstrap a new
 development Tool Shed to prepare it for importing a repository capsule
 whose contained repositories can be used as the foundation for developing
 new Galaxy tools and other utilities.  This development Tool Shed can be
 treated as a component in a multi-step process that simplifies and
 streamlines Galaxy tool development and validation in the local Tool Shed
 and moving the validated repositories into the test or main public Galaxy
 Tool Sheds.  Tool Shed framework enhancements included in the June 2, 2014
 release support this overall process, which will be explained fully in a
 future article.  Here we’ll restrict our discussion to highlights of the
 enhancements.

 Several files are included in a new directory named
 *~/lib/tool_shed/scripts/api/bootstrap_from_toolshed*.  The file named
 *user_info.xml.sample* should be copied to a file  with the same name,
 but eliminating the .sample extension (i.e., *user_info.xml*).  The
 information in this file is used to automatically create a new “admin” user
 account in your local development Tool Shed.  This should be the account
 you use in the test and main public Galaxy Tool Sheds if you plan to export
 your work from your development Tool Shed and import it into one or both of
 the public Tool Sheds.

 If you plan to use this new bootstrapping process, make sure your local
 development Tool Shed environment is pristine:

- The *hgweb.config* file must be empty or missing (it will
automatically get created if it doesn’t exist) and the configured location
for repositories must be an empty directory.
- The configured database must be new and not yet migrated.
- Make sure the
*~/lib/tool_shed/scripts/api/bootstrap_from_toolshed/user_info.xml *file
contains the desired account information.

 The *~/run_tool_shed.sh* script, used for starting up a Tool Shed, has
 been enhanced to enable this bootstrapping process by using a new
 *-bootstrap_from_tool_shed* flag.  Here’s an example.

 %sh run_tool_shed.sh -bootstrap_from_tool_shed http://toolshed.g2.bx.psu.edu

 The above example will initialize a local development Tool Shed (here
 we’ll assume its URL is http://localhost:9009) by bootstrapping from the
 main public Galaxy Tool Shed.  The bootstrapping process will perform the
 following actions in the order listed

Re: [galaxy-dev] Import of Capsules failing on local toolshed instance

2014-06-17 Thread Will Holtz
It looks like Dave fixed this issue in 4c58aa19a3d7. Thank you!

However I am still having import issues. I am now getting the message:
Archive of repository package_bowtie_0_12_7 owned by devteam
Import failed: repository owner devteam does not have an account in this
Tool Shed.
This is on a local toolshed running 9b78595ec11 where I am performing the
input from an admin account. I'm guessing the issue is that I have
'use_remote_user=True' for LDAP authentication and that means that a
devteam account cannot be automatically created to allow this capsule to be
added without modification. Perhaps on import of a capsule (by an
administrator) they could be given the option of preserving the existing
owners or re-assigning ownership to an existing user (defaulting to self)?

Of course, what I really want is inter-toolshed dependancies. Maybe I'm
missing something, but I'm finding it quite painful just to get a tool
development environment setup that makes use of any existing repositories.

thank you for your help,

-Will



On Wed, Jun 11, 2014 at 12:40 PM, Will Holtz who...@lygos.com wrote:

 I am now able to export capsules from the main/test toolsheds -- thanks
 Dave! When attempting to import these capsules into my local toolshed 
 (latest_2014.06.02
 for changeset fb68af9a775a) I receive the following error:

 URL: https://galaxy.lygos.com:99/repository/import_capsule
 File
 '/home/galaxy/galaxy-dist/lib/galaxy/web/framework/middleware/error.py',
 line 149 in __call__
   app_iter = self.application(environ, sr_checker)
 File
 '/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/debug/prints.py',
 line 106 in __call__
   environ, self.app)
 File
 '/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/wsgilib.py',
 line 543 in intercept_output
   app_iter = application(environ, replacement_start_response)
 File
 '/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/recursive.py',
 line 84 in __call__
   return self.application(environ, start_response)
 File
 '/home/galaxy/galaxy-dist/lib/galaxy/webapps/tool_shed/framework/middleware/remoteuser.py',
 line 74 in __call__
   return self.app( environ, start_response )
 File
 '/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/httpexceptions.py',
 line 633 in __call__
   return self.application(environ, start_response)
 File '/home/galaxy/galaxy-dist/lib/galaxy/web/framework/base.py', line 132
 in __call__
   return self.handle_request( environ, start_response )
 File '/home/galaxy/galaxy-dist/lib/galaxy/web/framework/base.py', line 190
 in handle_request
   body = method( trans, **kwargs )
 File
 '/home/galaxy/galaxy-dist/lib/galaxy/webapps/tool_shed/controllers/repository.py',
 line 1992 in import_capsule
   import_util.check_status_and_reset_downloadable( trans,
 import_results_tups )
 File '/home/galaxy/galaxy-dist/lib/tool_shed/util/import_util.py', line 34
 in check_status_and_reset_downloadable
   tip_changeset_revision = repository.tip( trans.app )
 AttributeError: 'NoneType' object has no attribute 'tip'

 I have seen the same behavior for capsules based on the following
 repositories from the test toolshed: package_biopython_1_62,
 package_vienna_rna_2_1, and package_bowtie_0_12_7. I am logged in as an
 admin user for the import process.

 thanks,
 -Will

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-dev] Postgresql database time wrong...

2014-06-17 Thread Will Holtz
Postgres generally stores datatime fields in GMT, and then translates them
to the local time zone when generating a query. Check the TimeZone variable
in your postgres.conf.

http://www.postgresql.org/docs/9.3/static/datatype-datetime.html#DATATYPE-TIMEZONES

-Will


On Tue, Jun 17, 2014 at 4:29 PM, neil.burd...@csiro.au wrote:

  Hi
I have quite a strange issue. I have a local install of Galaxy setup.
 When I type 'date' on my Ubuntu machine I get something like:

 Wed Jun 18 09:25:22 EST 2014

 When i then execute a job and look in the database at the create_time i.e.

 # select create_time from job order by create_time;

 I get

 2014-06-17 23:20:00.133828

 So about 10 hours different. Is there some configuration I need to set as
 Brisbane is 10hrs ahead of GMT (coincidence?)

 Thanks
 Neil

 ___
 Please keep all replies on the list by using reply all
 in your mail client.  To manage your subscriptions to this
 and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/

 To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/

___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

[galaxy-dev] Import of Capsules failing on local toolshed instance

2014-06-11 Thread Will Holtz
I am now able to export capsules from the main/test toolsheds -- thanks
Dave! When attempting to import these capsules into my local toolshed
(latest_2014.06.02
for changeset fb68af9a775a) I receive the following error:

URL: https://galaxy.lygos.com:99/repository/import_capsule
File
'/home/galaxy/galaxy-dist/lib/galaxy/web/framework/middleware/error.py',
line 149 in __call__
  app_iter = self.application(environ, sr_checker)
File
'/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/debug/prints.py',
line 106 in __call__
  environ, self.app)
File
'/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/wsgilib.py',
line 543 in intercept_output
  app_iter = application(environ, replacement_start_response)
File
'/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/recursive.py',
line 84 in __call__
  return self.application(environ, start_response)
File
'/home/galaxy/galaxy-dist/lib/galaxy/webapps/tool_shed/framework/middleware/remoteuser.py',
line 74 in __call__
  return self.app( environ, start_response )
File
'/home/galaxy/galaxy-dist/eggs/Paste-1.7.5.1-py2.7.egg/paste/httpexceptions.py',
line 633 in __call__
  return self.application(environ, start_response)
File '/home/galaxy/galaxy-dist/lib/galaxy/web/framework/base.py', line 132
in __call__
  return self.handle_request( environ, start_response )
File '/home/galaxy/galaxy-dist/lib/galaxy/web/framework/base.py', line 190
in handle_request
  body = method( trans, **kwargs )
File
'/home/galaxy/galaxy-dist/lib/galaxy/webapps/tool_shed/controllers/repository.py',
line 1992 in import_capsule
  import_util.check_status_and_reset_downloadable( trans,
import_results_tups )
File '/home/galaxy/galaxy-dist/lib/tool_shed/util/import_util.py', line 34
in check_status_and_reset_downloadable
  tip_changeset_revision = repository.tip( trans.app )
AttributeError: 'NoneType' object has no attribute 'tip'

I have seen the same behavior for capsules based on the following
repositories from the test toolshed: package_biopython_1_62,
package_vienna_rna_2_1, and package_bowtie_0_12_7. I am logged in as an
admin user for the import process.

thanks,
-Will
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

Re: [galaxy-dev] RFC: Citations for tools

2014-05-27 Thread Will Holtz
As hinted at in the Trello card Greg posted, it could be much simpler if
the citation tag just took a DOI. It appears that the DOI to bibtex
conversion can be done by Crossref:
http://tex.stackexchange.com/questions/6848/automatically-dereference-doi-to-bib

-Will



On Tue, May 27, 2014 at 10:16 AM, Greg Von Kuster g...@bx.psu.edu wrote:

 Peter, this may be the Trello card you were thinking of.

 https://trello.com/c/kY7RCnd0/95-tool-shed-citation-for-tools-dois

 Greg Von Kuster


 On May 27, 2014, at 1:09 PM, Peter Cock p.j.a.c...@googlemail.com wrote:

  Hi Eric,
 
  I was sure there was a Trello card for this, but I can't find it right
 now...
 
  I've pushed this idea on the mailing list before, and in person at
  the Galaxy Community Conference too. See also these threads:
 
  http://lists.bx.psu.edu/pipermail/galaxy-dev/2011-December/007873.html
 
  http://lists.bx.psu.edu/pipermail/galaxy-dev/2012-June/010178.html
 
  Are you familiar enough with the area of semantic web/linked
  data to know what would be the best XML based markup to
  use for embedding the citations?
 
  i.e. We should not reinvent the wheel here ;)
 
  Peter
 
 
  On Tue, May 27, 2014 at 5:54 PM, James Taylor ja...@jamestaylor.org
 wrote:
  Eric, I'm very much in favor of this feature, and particularly the
  idea of generating a list of citations from a history or workflow. I
  imagine the only thing to quibble about will be the syntax. There are
  already some efforts to represent bibtex in xml (e.g.
  https://github.com/Zearin/BibTeXML), however they have always struck
  me as overly verbose.
 
  -- jt
 
 
  On Tue, May 27, 2014 at 12:45 PM, Eric Rasche rasche.e...@yandex.ru
 wrote:
  -BEGIN PGP SIGNED MESSAGE-
  Hash: SHA1
 
  I'd want to open up discussion on a feature I'd like to see. I'll try
  and implement it if I can find time this summer. I didn't see a trello
  card for anything like this yet, but please feel free to direct me
 there
  if I missed it.
 
 
  I'd like to see citations as a part of every tool.
 
  This would happen in the form of a citation block in the XML, which
  would contain sub-elements with text. These sub-elements could be based
  off of BibTeX, since they have existing specs for citing things:
  https://en.wikipedia.org/wiki/BibTeX
 
  These citations would then be accessible in the HTML generated tool
  pages, or via a View/Download button somewhere on the tool page. By
  storing as an XML tree, we could render these citations as BibTeX
  entries for the LaTeX users, and I believe there are ways to convert
  BibTeX to EndNote XML and so on.
 
  This could be extended for use in workflows so that when you run
  workflows, somehow a list of citations for all tools used could be
  generated.
 
  Anyone have thoughts or opinions on this?
 
 
 
 
  Using the example bibtex entry from the wikipedia page:
 
  @Book{abramowitz+stegun,
  author= Milton {Abramowitz} and Irene A. {Stegun},
  title = Handbook of Mathematical Functions with
   Formulas, Graphs, and Mathematical Tables,
  publisher = Dover,
  year  =  1964,
  address   = New York,
  edition   = ninth Dover printing, tenth GPO printing
  }
 
  I imagine it'd look like the following in a real-life tool:
 
  tool
   ...
   citation type=book
 authorMilton Abramowitz and Irene A. Stegun/author
 titleHandbook of Mathematical Functions with Formulas, Graphs, and
  Mathematical Tables/title
 publisherDover/publisher
 year1964/year
 addressNew York/address
 editionninth Dover printing, tenth GPO printing/edition
   /citation
  /tool
 
 
  Cheers,
  Eric
  - --
  Eric Rasche
  Programmer II
  Center for Phage Technology
  Texas AM University
  College Station, TX 77843
  404-692-2048
  e...@tamu.edu
  rasche.e...@yandex.ru
  -BEGIN PGP SIGNATURE-
  Version: GnuPG v2.0.17 (GNU/Linux)
 
  iQIcBAEBAgAGBQJThMEUAAoJEMqDXdrsMcpVe9AP/1BjPbP5JdK6KDybOeV2ElvC
  jvmUGetAjdQzkKO1Ikeuxb46yp0j4abAGGG92AccxlBYALsT3jsPv5dYjm505vcU
  IwlfTBE7gc5y19x3zx1CuAd7PB11tryODz2LwXNKI75f39bNdX6Qe5aA74Vn/k8a
  FBeFL/EvkZwI8Z6CvuTGtZrEHvDXVvTFoxMX875f59g2vNy7W8Fh5wQCQ8qgiogi
  0SWGIGZ6OJdqX60h2hOjJ06NhzBcTsjQea+AwTo5wAkyGPFJy4DV78jKOvsd5PMG
  qkk4U6gBcmcFolCeItlLPa/C4uiyOK2wVWHyTnEeKjdpD6dwLuemRmwtZrModbQu
  PPPFkKzQhUnh5Wgq8TIP4kSc2t1/jSpdV8MHqM0piqOFnR52fExPrwLn82WEFcp8
  tXfHHTaZj+6gL+IGswdAgqvxk1V+6QTjH57igWmYtcENpIDbhZVBh+HOD8SS2qdv
  ohwFg/Vn8VrCeTGGehNSBvkam0HXjXXq7mZ8W4xrOS8vxv8HPAFZHze2sPlUG/Ob
  WeOdiLgD2HCH95SXYDDBNFG6HwFkLETA3DjpfvgHqPdaLmEfIZW+ks1WF9RG+Pmo
  jhbWH8OmtTk5A/Zh63uRowMaDe7QSCruPIfIwlrgqLozOj8htMyJPBIW9oZGGkqC
  7Vu5UFeL8gcigRmQv5NA
  =ceAo
  -END PGP SIGNATURE-
  ___
  Please keep all replies on the list by using reply all
  in your mail client.  To manage your subscriptions to this
  and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/
 
  To search Galaxy mailing lists use the unified search 

[galaxy-dev] Problem upgrading bx-python to fix trackster error.

2014-04-09 Thread William Holtz
I have a set of galaxy generated bam and bigwig files containing over 600 
contigs. When I attempt to view any of these files with trackster (on a local 
server running current galaxy-dist) I get the following in my log file:

galaxy.webapps.galaxy.api.datasets ERROR 2014-04-09 17:41:16,063 Error in 
dataset API at listing contents: 'BinaryFileReader' object has no attribute 
'read_bits64': 'BinaryFileReader' object has no attribute 'read_bits64'
Traceback (most recent call last):
  File /home/galaxy/galaxy-dist/lib/galaxy/webapps/galaxy/api/datasets.py, 
line 44, in show
    is_true( kwd.get( 'retry', False ) ) )
  File /home/galaxy/galaxy-dist/lib/galaxy/webapps/galaxy/api/datasets.py, 
line 106, in _converted_datasets_state
    if not data_provider.has_data( chrom ):
  File 
/home/galaxy/galaxy-dist/lib/galaxy/visualization/data_providers/genome.py, 
line 1078, in has_data
    all_dat = bbi.query( chrom, 0, 2147483647, 1 ) or \
  File bbi_file.pyx, line 215, in bx.bbi.bbi_file.BBIFile.query 
(lib/bx/bbi/bbi_file.c:5596)  File bbi_file.pyx, line 222, in 
bx.bbi.bbi_file.BBIFile.query (lib/bx/bbi/bbi_file.c:5210)
  File bbi_file.pyx, line 183, in bx.bbi.bbi_file.BBIFile.summarize 
(lib/bx/bbi/bbi_file.c:4475)
  File bbi_file.pyx, line 248, in 
bx.bbi.bbi_file.BBIFile._get_chrom_id_and_size (lib/bx/bbi/bbi_file.c:5656)
  File bpt_file.pyx, line 76, in bx.bbi.bpt_file.BPTFile.find 
(lib/bx/bbi/bpt_file.c:1388)  File bpt_file.pyx, line 55, in 
bx.bbi.bpt_file.BPTFile.r_find (lib/bx/bbi/bpt_file.c:1154)
AttributeError: 'BinaryFileReader' object has no attribute 'read_bits64'

Two people have previously reported similar errors to this list. I don't know 
how to reply to messages that predate me joining the list, so here are links to 
the threads:
http://dev.list.galaxyproject.org/read-bits64-error-when-loading-large-genomes-data-into-trackster-tp4663622.html
http://dev.list.galaxyproject.org/trackster-error-for-viewing-rat-data-rn5-tp4662664.html


Following the suggestion of Jeremy Goecks in one of those old threads, I 
checked my bx-python version. The directory name bx-python is installed in 
indicates that I have version 0.7.1. Version 0.7.1 is from 2011 and pre-dates 
the the bug Jeremy mentioned 
(https://bitbucket.org/james_taylor/bx-python/commits/24893a84ce13a18815e3006c9f89b3828022ac96).
 Additionally, I ran:
strings 
./galaxy-dist/eggs/bx_python-0.7.1_7b95ff194725-py2.7-linux-x86_64-ucs4.egg/bx/bbi/bpt_file.so
 | grep read_bits64
and found a match, thus confirming the installed version pre-dates the bug fix, 
as all references to read_bits64 were removed in that commit. Additionally I 
cloned and compiled the current version of bx-python and found that the above 
command did not find any matches.

The offending installation of bx-python is part of the base installation of 
galaxy and not an item I added from the toolshed. I am unsure of how to go 
about replacing this egg with the newer version of bx-python. If someone can 
update the bx-python egg on http://eggs.g2.bx.psu.edu/ or give me instructions 
on how to replace my copy of the egg, I would greatly appreciate it!

Additionally, I found that all three of the versions of bx-python in the 
galaxy-main toolshed still contain this bug. Of the three versions of bx-python 
int the galaxy-test toolshed, only 3:5457e32b427c (2013-12-14) contains the bug 
fix.

Thank you in advance for your assistance!

-Will
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

[galaxy-dev] maximum recursion depth error

2013-05-20 Thread Ann Holtz-Morris, M.S.

Hi,
I used the SAM to FASTQ tool to divide78 lines of Illimina paired end 
sequences in SAM format to FASTQ format. The read 2 data set works fine, and 
I used the FASTQ masker and then FASTQ to FASTA  tools.


I went to repeat those steps with the the read 1 data set. It errors with:

Error executing tool: maximum recursion depth exceeded while calling a 
Python object.


Thinking maybe the format was corrupted, I ran FASTQ groomer.  Same result:

Error executing tool: maximum recursion depth exceeded while calling a 
Python object.


Thinking the SAM to FASTQ had a problem, I repeated it. Same result:

Error executing tool: maximum recursion depth exceeded while calling a 
Python object.


You get thepicture. Anything I try with this data gives the same error.


When I googled the error, the top results were all about large data sets, 
but this isn't a large set.


Any help greatly appreciated,
Ann

Thanks for your help.
CONFIDENTIALITY NOTICE: This electronic message is intended to be for the use 
only of the named recipient, and may contain information that is confidential 
or privileged. If you are not the intended recipient, you are hereby notified 
that any disclosure, copying, distribution or use of the contents of this 
message is strictly prohibited. If you have received this message in error or 
are not the named recipient, please notify us immediately by contacting the 
sender at the electronic mail address noted above, and delete and destroy all 
copies of this message. Thank you.
___
Please keep all replies on the list by using reply all
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
 http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
 http://galaxyproject.org/search/mailinglists/