[Bug 1298921] Re: cloud-init should give up on 404 errors
This bug was fixed in the package cloud-init - 18.1-35-ge0f644b7-0ubuntu1 --- cloud-init (18.1-35-ge0f644b7-0ubuntu1) bionic; urgency=medium * debian/cloud-init.templates: enable IBMCloud datasource. * New upstream snapshot. - IBMCloud: Initial IBM Cloud datasource. - tests: remove jsonschema from xenial tox environment. - tests: Fix newly added schema unit tests to skip if no jsonschema. - ec2: Adjust ec2 datasource after exception_cb change. - Reduce AzurePreprovisioning HTTP timeouts. [Douglas Jordan] (LP: #1752977) - Revert the logic of exception_cb in read_url. [Kurt Garloff] (LP: #1702160, #1298921) - ubuntu-advantage: Add new config module to support ubuntu-advantage-tools - Handle global dns entries in netplan (LP: #1750884) - Identify OpenTelekomCloud Xen as OpenStack DS. [Kurt Garloff] (LP: #1756471) -- Chad Smith Fri, 23 Mar 2018 17:20:47 -0600 ** Changed in: cloud-init (Ubuntu) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
** Merge proposal linked: https://code.launchpad.net/~chad.smith/cloud-init/+git/cloud-init/+merge/342011 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
An upstream commit landed for this bug. To view that commit see the following URL: https://git.launchpad.net/cloud-init/commit/?id=097a2967 ** Changed in: cloud-init (Ubuntu) Status: Confirmed => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
** Merge proposal linked: https://code.launchpad.net/~kgarloff/cloud-init/+git/cloud-init/+merge/341844 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
See also issue #1702160 https://bugs.launchpad.net/cloud-init/+bug/1702160 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
Any news on this? I'm also seeing 404 errors and a 2 minute timeout. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
Scott, This is the first time I'm hearing about "cloudsigma", I'm pretty sure that I'm not running there, since this is a KVM Guest running at my own Ubuntu physical host, that I installed using Ubuntu ISO. So, this might be another bug... Or maybe not, because it is not giving up on 404 errors... Do you know any way to disable this second datasource that it uses automatically as a fall back ? Thanks! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
Thiago, the CloudSigma datasource is the one that is doing the http requests listed above. That datasource cannot be configured with timeout. It should be a fairly easy fix to add that. Note, though that if you're hitting the cloudsigma datasource, you are likely running on cloudsigma or there is another bug. the cloudsigma code in trunk at the moment does a 'is_running_cloudsigma' check that should have very few false positives. See: http://bazaar.launchpad.net/~cloud-init-dev/cloud-init/trunk/view/head:/cloudinit/sources/DataSourceCloudSigma.py#L45 it should only return True if 'system-product-name' from the host- provided dmi data has 'cloudsigma' in it. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
Any news on this guys? I'm trying to create a QCoW2 image with Cloud Init, using Packer, everything seems t be okay but, I'm seeing the following problem: --- 2015-10-10 02:27:39,689 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [20/30s]: unexpected error ['NoneType' object has no attribute 'status_code'] 2015-10-10 02:27:48,704 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [29/30s]: unexpected error ['NoneType' object has no attribute 'status_code'] 2015-10-10 02:27:49,705 - DataSourceEc2.py[CRITICAL]: Giving up on md from ['http://169.254.169.254/2009-04-04/meta-data/instance-id'] after 30 seconds 2015-10-10 02:27:49,717 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [0/120s]: bad status code [404] 2015-10-10 02:27:50,730 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [1/120s]: bad status code [404] 2015-10-10 02:27:51,740 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [2/120s]: bad status code [404] 2015-10-10 02:27:52,750 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [3/120s]: bad status code [404] 2015-10-10 02:27:53,760 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [4/120s]: bad status code [404] 2015-10-10 02:27:54,772 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [5/120s]: bad status code [404] 2015-10-10 02:27:56,783 - url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [7/120s]: bad status code [404] --- I'm seeing this problem, inside by testing environment, where I do NOT have any Metadata server... I tried to reduce the timeout, by creating the following file: 10_ec2_timeouts.cfg: --- datasource: MAAS: timeout : 50 max_wait : 120 OpenStack: timeout : 20 max_wait : 30 Ec2: timeout : 20 max_wait : 30 --- But, it didn't worked! The first Metadaserver "http://169.254.169.254"; was reduced but, the second Metadata server "http://192.168.122.1"; still have 120s of timeout! How to reduce the timeout for all tries that cloud-init will execute? Thanks! Thiago -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
** Changed in: cloud-init (Ubuntu) Importance: Undecided => Low -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
CloudStack was add to default list at revno 217 during the Quantal cycle. So its been there for a while. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: cloud-init (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
> In one way or another, the CloudStack datasource was explicitly enabled. > You or something explicitly configured this datasource on, and to be run > before the Ec2 datasource, so generally its functioning > as designed. Well it wasn't explicitly disabled :-) > Additionally, its not a 404 that we get as the error, but a Connection Refused. Weird. I know I got 404 errors at one point. Need to redo my testing when I'm back in the office. > there must be a config file in /etc/cloud/ that enables the CloudStack datasource, and lists it before the ConfigDrive datasource, Yes there is. It seems that the list in Debian is in the wrong order. However, I think the actual ordering should be enforced by cloud-init if it is that crucial and breaks otherwise (as seen in this case). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
Juergh, Thanks for posting the log. Relevant info from the log: Mar 31 10:00:05 hlinux [CLOUDINIT] util.py[DEBUG]: Cloud-init v. 0.7.2 running 'single' at Mon, 31 Mar 2014 10:00:05 +. Up 3090.59 seconds. pt.conf.d/90cloud-init-pipelining with apt pipeline depth setting 0 ... Mar 31 10:01:10 hlinux [CLOUDINIT] util.py[DEBUG]: Cloud-init v. 0.7.2 running 'init' at Mon, 31 Mar 2014 10:01:10 +. Up 3155.70 seconds. Mar 31 10:01:10 hlinux [CLOUDINIT] __init__.py[DEBUG]: Looking for for data source in: ['NoCloud', 'AltCloud', 'CloudStack', 'ConfigDrive', 'Ec2', 'MAAS', 'OVF', 'None'], via packages ['', 'cloudinit.sources'] that matches dependencies ['FILESYSTEM', 'NETWORK'] ... Mar 31 10:01:10 hlinux [CLOUDINIT] __init__.py[DEBUG]: Seeing if we can get any data from Mar 31 10:01:10 hlinux [CLOUDINIT] DataSourceCloudStack.py[DEBUG]: Using /var/lib/dhcp lease directory Mar 31 10:01:10 hlinux [CLOUDINIT] DataSourceCloudStack.py[DEBUG]: Found DHCP identifier 192.168.122.1 Mar 31 10:01:10 hlinux [CLOUDINIT] DataSourceCloudStack.py[DEBUG]: Found DHCP identifier 192.168.122.1 Mar 31 10:01:10 hlinux [CLOUDINIT] util.py[DEBUG]: Reading from /var/lib/cloud/seed/cs/meta-data (quiet=False) Mar 31 10:01:10 hlinux [CLOUDINIT] url_helper.py[DEBUG]: [0/1] open 'http://192.168.122.1//latest/meta-data/instance-id' with {'url': 'http://192.168.122.1//latest/meta-data/instance-id', 'headers': {'User-Agent': 'Cloud-Init/0.7.2'}, 'allow_redirects': True, 'method': 'GET', 'timeout': 50.0} configuration Mar 31 10:01:10 hlinux [CLOUDINIT] url_helper.py[WARNING]: Calling 'http://192.168.122.1//latest/meta-data/instance-id' failed [0/120s]: request error [HTTPConnectionPool(host='192.168.122.1', port=80): Max retries exceeded with url: //latest/meta-data/instance-id (Caused by : [Errno 111] Connection refused)] So, this is 0.7.2, and I believe there must be a config file in /etc/cloud/ that enables the CloudStack datasource, and lists it before the ConfigDrive datasource, as the built in config (in cloudinit/settings.py) for 0.7.2 has: 'datasource_list': [ 'NoCloud', 'ConfigDrive', 'AltCloud', 'OVF', 'MAAS', 'Ec2', 'CloudStack', # At the end to act as a 'catch' when none of the above work... 'None', ], In one way or another, the CloudStack datasource was explicitly enabled. Additionally, its not a 404 that we get as the error, but a Connection Refused. You or something explicitly configured this datasource on, and to be run before the Ec2 datasource, so generally its functioning as designed. I don't generally disagree with the idea, and don't like the polling behavior either. But when CloudStack was added, it was added with this annoying polling behavior (The Ec2 datasource also has this behavior, to account for the possibility that the metadata server "just isnt there yet"). Before removing the poll/timeout behavior, I'd need to get some ACK from someone involved with CloudStack that this would not break any situations. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
It would seem you've mis-configured something if you're hitting this. Default settings put OpenStack before CloudStack, so it should only do this if you've somehow not found a openstack datasource. can you post your whole cloud-init.log ? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1298921] Re: cloud-init should give up on 404 errors
** Branch linked: lp:~juergh/cloud-init/lp1298921 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1298921 Title: cloud-init should give up on 404 errors To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1298921/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs