[galaxy-dev] CloudMan auto-scaling - Use spot instance for worker node?
Hi all, I realize when you manually add a node you can request that it be a spot instance. Is it also possible to use spot instances for auto-scaling? Thank you very much, Robert This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Re: [galaxy-dev] CloudMan: Autoscaling =Unable to run this job due to a cluster error
Hi Enis, I have indeed set the master node to not run jobs. Does there has to be at least one execution host (either master or always on worker) auto scaling to work? Thanks for the help, Robert From: Enis Afgan [afg...@gmail.com] Sent: Thursday, October 09, 2014 11:30 AM To: Petit III, Robert A. Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] CloudMan: Autoscaling =Unable to run this job due to a cluster error Hi Robert, Can you check on CloudMan's Admin page if the following is shown (towards the bottom of the page): Switch master to not run jobs If it says, Switch master to run jobs, just click on the text and the master will become an execution host on the cluster, which should then give Galaxy some resources to run the jobs on. Sorry for the trouble and let us know if this does not fix it, Enis On Wed, Oct 8, 2014 at 6:34 PM, Petit III, Robert A. robert.pe...@emory.edumailto:robert.pe...@emory.edu wrote: Hello Galaxy Team! I've set up a vanilla CloudMan instance using AWS. I've set the head node to not handle jobs and have set AutoScaling to a minimum of 0 and a maximum of 4 worker nodes. Upon submitting a job, it fails with the following error: Unable to run this job due to a cluster error, please retry it later Now if I set AutoScaling to a minimum of 1 worker node it works fine. But I would rather not always have 1 worker node up. Any recommendations? Thank you very much, Robert This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
[galaxy-dev] CloudMan: Autoscaling =Unable to run this job due to a cluster error
Hello Galaxy Team! I've set up a vanilla CloudMan instance using AWS. I've set the head node to not handle jobs and have set AutoScaling to a minimum of 0 and a maximum of 4 worker nodes. Upon submitting a job, it fails with the following error: Unable to run this job due to a cluster error, please retry it later Now if I set AutoScaling to a minimum of 1 worker node it works fine. But I would rather not always have 1 worker node up. Any recommendations? Thank you very much, Robert This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Re: [galaxy-dev] Batch limit on Wokflows
Here's the latest. I have tested this on Chrome, Firefox, and IE. I've tried the latest revisions of galaxy-central (71031bf3105c) and galaxy-dist (26920e20157f) straight out of the box (hg clone, sh run.sh, go to localhost:8080). I am still running into same issue. All is well with 19 or less datasets in the history, but as soon as I add a 20th I can no longer run a workflow on multiple datasets. Are there any known issues running galaxy on Ubuntu 10.04? This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Batch limit on Wokflows
Workflow is beginning directly with a tool. An example test workflow I've been trying is, I have 20 fasta files, and the workflow has only the FASTA-to-Tabular tool. Thanks, Robert From: Dannon Baker [dannonba...@me.com] Sent: Tuesday, February 14, 2012 3:33 PM To: Petit III, Robert A. Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Batch limit on Wokflows I hadn't had a chance to follow up again yet, but in your workflow, are you using an Input Dataset step, or do you have the workflow beginning directly with a tool? -Dannon On Feb 14, 2012, at 3:26 PM, Petit III, Robert A. wrote: Here's the latest. I have tested this on Chrome, Firefox, and IE. I've tried the latest revisions of galaxy-central (71031bf3105c) and galaxy-dist (26920e20157f) straight out of the box (hg clone, sh run.sh, go to localhost:8080). I am still running into same issue. All is well with 19 or less datasets in the history, but as soon as I add a 20th I can no longer run a workflow on multiple datasets. Are there any known issues running galaxy on Ubuntu 10.04? This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Batch limit on Wokflows
Thats it! Consider this resolved, and total operator error. I tried using the 'Input Dataset' step, and am no longer having issues. Thanks for the help Dannon. From: Petit III, Robert A. Sent: Tuesday, February 14, 2012 3:49 PM To: galaxy-dev@lists.bx.psu.edu Subject: RE: [galaxy-dev] Batch limit on Wokflows Workflow is beginning directly with a tool. An example test workflow I've been trying is, I have 20 fasta files, and the workflow has only the FASTA-to-Tabular tool. Thanks, Robert From: Dannon Baker [dannonba...@me.com] Sent: Tuesday, February 14, 2012 3:33 PM To: Petit III, Robert A. Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Batch limit on Wokflows I hadn't had a chance to follow up again yet, but in your workflow, are you using an Input Dataset step, or do you have the workflow beginning directly with a tool? -Dannon On Feb 14, 2012, at 3:26 PM, Petit III, Robert A. wrote: Here's the latest. I have tested this on Chrome, Firefox, and IE. I've tried the latest revisions of galaxy-central (71031bf3105c) and galaxy-dist (26920e20157f) straight out of the box (hg clone, sh run.sh, go to localhost:8080). I am still running into same issue. All is well with 19 or less datasets in the history, but as soon as I add a 20th I can no longer run a workflow on multiple datasets. Are there any known issues running galaxy on Ubuntu 10.04? This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Batch limit on Wokflows
Sorry for the delay, but I am using a galaxy-dist clone, and have updated to revision 26920e20157f+ tip. I'm still receiving the same issue with the revision. Maybe I should try out galaxy-central? Thanks, Robert From: Dannon Baker [dannonba...@me.com] Sent: Friday, February 10, 2012 11:50 AM To: Petit III, Robert A. Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Batch limit on Wokflows What revision is your Galaxy instance at? I'm not seeing this behavior on tip with a simple test, it may have been something we've fixed in a more recent revision. -Dannon On Feb 10, 2012, at 11:14 AM, Petit III, Robert A. wrote: Hi there, I've run into an issue on my local galaxy install. When I have 20 or more datasets in my history, I no longer get the option to 'Enable/Disable selection of multiple input files...' I instead get a broken drop down list. I say broken because its as though the drop down list and input box have merged together. Is there a setting I need to change to correct this? Thanks Robert This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
Re: [galaxy-dev] Batch limit on Wokflows
OK, I've tried the latest revision og 'Galaxy-Central' and am still running into the same issue, when I try to run a work flow when there are 20+ datasets in my history. I might try setting it up on another machine to see if I run into the same issue. Thanks, Robert From: Petit III, Robert A. Sent: Monday, February 13, 2012 11:05 AM To: galaxy-dev@lists.bx.psu.edu Subject: RE: [galaxy-dev] Batch limit on Wokflows Sorry for the delay, but I am using a galaxy-dist clone, and have updated to revision 26920e20157f+ tip. I'm still receiving the same issue with the revision. Maybe I should try out galaxy-central? Thanks, Robert From: Dannon Baker [dannonba...@me.com] Sent: Friday, February 10, 2012 11:50 AM To: Petit III, Robert A. Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Batch limit on Wokflows What revision is your Galaxy instance at? I'm not seeing this behavior on tip with a simple test, it may have been something we've fixed in a more recent revision. -Dannon On Feb 10, 2012, at 11:14 AM, Petit III, Robert A. wrote: Hi there, I've run into an issue on my local galaxy install. When I have 20 or more datasets in my history, I no longer get the option to 'Enable/Disable selection of multiple input files...' I instead get a broken drop down list. I say broken because its as though the drop down list and input box have merged together. Is there a setting I need to change to correct this? Thanks Robert This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
[galaxy-dev] Batch limit on Wokflows
Hi there, I've run into an issue on my local galaxy install. When I have 20 or more datasets in my history, I no longer get the option to 'Enable/Disable selection of multiple input files...' I instead get a broken drop down list. I say broken because its as though the drop down list and input box have merged together. Is there a setting I need to change to correct this? Thanks Robert This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). ___ Please keep all replies on the list by using reply all in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
