[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in Ubuntu. https://bugs.launchpad.net/bugs/461156 Title: User data is not parsed correctly by Eucalyptus in some cases To manage notifications about this bug go to: https://bugs.launchpad.net/eucalyptus/+bug/461156/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Fairly sure this is fix-released in Eucalyptus, right? -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Should be, yes. -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
This bug was fixed in the package eucalyptus - 1.6~bzr931-0ubuntu7.4 --- eucalyptus (1.6~bzr931-0ubuntu7.4) karmic-proposed; urgency=low [ Thierry Carrez ] * cluster/handlers.c: Cherrypick upstream r946: initialize axis2c in the CC for each NC client connection, to avoid rampart memory leak (LP: #460085) * clc/modules/wsstack/src/main/java/com/eucalyptus/ws/handlers/HmacV2Handler.java: Cherrypick upstream r1079: Fix authentication issue when using a euca2ools that doesn't double base64encode userdata (LP: #461156) [ Dustin Kirkland ] * debian/eucalyptus-cc.upstart, debian/eucalyptus-common.eucalyptus.upstart: support CLEAN=1 on start/stop/restart of eucalyptus/euclayptus-cc; export the CLEAN env variable in eucalyptus.init, and handle it in both the pre-start and post-stop sections of eucalyptus-cc, (LP: #491254) -- Dustin Kirkland kirkl...@ubuntu.com Wed, 02 Dec 2009 17:58:18 -0600 ** Changed in: eucalyptus (Ubuntu Karmic) Status: Fix Committed = Fix Released -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Verification: With karmic / karmic-updates : FAIL With karmic-proposed (eucalyptus + euca2ools): PASS ** Tags added: verification-done ** Tags removed: verification-needed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Branch linked: lp:ubuntu/karmic-proposed/euca2ools -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Thierry- Can you verify this package? We need other fixes associated with this update here onsite at a partner. -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Accepted eucalyptus into karmic-proposed, the package will build now and be available in a few hours. Please test and give feedback here. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you in advance! ** Tags added: verification-needed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Branch linked: lp:ubuntu/karmic-proposed/eucalyptus -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: euca2ools (Ubuntu Karmic) Status: In Progress = Fix Committed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Description changed: - User data supplied using euca-run-instances --user-data-file is not decoded before being presented to the instance. - Inside the instance, curl http://169.254.169.254/latest/user-data; should fetch the decoded user data, whereas eucalyptus will return a base64 and url encoded string. This breaks ec2-run-user-data from the ec2-init package, rendering instance configuration using the user-data mechanism unusable. + User data supplied using euca-run-instances --user-data-file is not decoded before being presented to the instance. + Inside the instance, curl http://169.254.169.254/latest/user-data; should fetch the decoded user data, whereas eucalyptus will return a base64 and url encoded string. This breaks ec2-run-user-data from the ec2-init package, rendering instance configuration using the user-data mechanism unusable. EC2 documentation at http://docs.amazonwebservices.com/AWSEC2/2007-03-01/DeveloperGuide/AESDG-chapter-instancedata.html states that EC2 will return decoded data (i don't have a ec2 account so i can't confirm this): The user data must be base64-encoded before being submitted to the API. The API command-line tools perform the base64-encoding for you. The data will be base64 decoded before being presented to the instance. + + = + SRU Report (eucalyptus, euca2ools): + + Impact: This bug makes userdata unusable in cloud images used withing + UEC. userdata is used for a lot of things, in particular boot-time + configuration of our cloud images. This works within EC2 but not within + UEC, due to this bug. + + This requires a fix in euca2ools (do not b64_encode twice). But fixing + it in euca2ools triggers a bug in eucalyptus when certain userdata is + received (the previous bug was protecting eucalyptus from this), so this + needs a eucalyptus update as well. + + Fix in development release: This was fixed in lucid in eucalyptus + (1.6.1~bzr1083-0ubuntu1) by applying the same patch. Was not fixed in + euca2ools yet. + + Minimal patch for eucalyptus: + http://bazaar.launchpad.net/~ubuntu-core-dev/eucalyptus/ubuntu-karmic/revision/726 + + Minimal patch for euca2ools: + --- euca2ools-1.0+bzr20091007.orig/bin/euca-run-instances + +++ euca2ools-1.0+bzr20091007/bin/euca-run-instances + @@ -170,8 +170,6 @@ + print 'Invalid user data file path' + sys.exit(1) + user_data = read_user_data(user_data_file) + - if user_data: + - user_data = base64.urlsafe_b64encode(user_data) + euca_conn = euca.make_connection() + try: + reservation = euca_conn.run_instances(image_id = image_id, + + TEST CASE: + euca-run-instances -k $MYKEY --user-data FOO $EMI -t c1.medium + ssh -i $MYKEYPRIV ubu...@$ip 'wget -q http://169.254.169.254/latest/user-data -O -'; echo + Expected results: should return FOO + Fails with affected euca2ools and eucalyptus (returns IDw8IEZPTyA- instead of FOO ) + Succeeds with proposed euca2ools and proposed eucalyptus. + + Regression potential: + The regression potential is small, since userdata is not really usable right now. In euca2ools, only someone relying on the bug (and base64_decoding the userdata in the cloud image itself) would be affected. Regression potential is slightly higher on eucalyptus side, since the fix is about escaping special characters in userdata. Careful testing with various userdata strings (to hit the special characters in the urlsafe-base64-encoded string) is necessary. = Karmic release notes: user-data not usable by guest instances Starting an instance with euca-run-instances and user-data (either using the -d, --user-data option or the -f, --user-data-file option) will store the user data in base64 encoding. Accessing the user data from the instance at http://169.254.169.254/latest/user-data will return the user data in base64 encoding. Because of this bug ec2-init is unable make use of user-data. In order to use this data it must first be decoded. A fix for this issue is expected to be provided in a post- release update immediately after the Ubuntu 9.10 release. == -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Description changed: User data supplied using euca-run-instances --user-data-file is not decoded before being presented to the instance. Inside the instance, curl http://169.254.169.254/latest/user-data; should fetch the decoded user data, whereas eucalyptus will return a base64 and url encoded string. This breaks ec2-run-user-data from the ec2-init package, rendering instance configuration using the user-data mechanism unusable. EC2 documentation at http://docs.amazonwebservices.com/AWSEC2/2007-03-01/DeveloperGuide/AESDG-chapter-instancedata.html states that EC2 will return decoded data (i don't have a ec2 account so i can't confirm this): The user data must be base64-encoded before being submitted to the API. The API command-line tools perform the base64-encoding for you. The data will be base64 decoded before being presented to the instance. = SRU Report (eucalyptus, euca2ools): Impact: This bug makes userdata unusable in cloud images used withing UEC. userdata is used for a lot of things, in particular boot-time configuration of our cloud images. This works within EC2 but not within UEC, due to this bug. This requires a fix in euca2ools (do not b64_encode twice). But fixing it in euca2ools triggers a bug in eucalyptus when certain userdata is received (the previous bug was protecting eucalyptus from this), so this needs a eucalyptus update as well. Fix in development release: This was fixed in lucid in eucalyptus - (1.6.1~bzr1083-0ubuntu1) by applying the same patch. Was not fixed in - euca2ools yet. + (1.6.1~bzr1083-0ubuntu1) and in euca2ools (1.0+bzr20091007-0ubuntu2) by + applying the same patches. Minimal patch for eucalyptus: http://bazaar.launchpad.net/~ubuntu-core-dev/eucalyptus/ubuntu-karmic/revision/726 Minimal patch for euca2ools: --- euca2ools-1.0+bzr20091007.orig/bin/euca-run-instances +++ euca2ools-1.0+bzr20091007/bin/euca-run-instances @@ -170,8 +170,6 @@ - print 'Invalid user data file path' - sys.exit(1) - user_data = read_user_data(user_data_file) + print 'Invalid user data file path' + sys.exit(1) + user_data = read_user_data(user_data_file) - if user_data: - user_data = base64.urlsafe_b64encode(user_data) - euca_conn = euca.make_connection() - try: - reservation = euca_conn.run_instances(image_id = image_id, + euca_conn = euca.make_connection() + try: + reservation = euca_conn.run_instances(image_id = image_id, TEST CASE: euca-run-instances -k $MYKEY --user-data FOO $EMI -t c1.medium ssh -i $MYKEYPRIV ubu...@$ip 'wget -q http://169.254.169.254/latest/user-data -O -'; echo Expected results: should return FOO Fails with affected euca2ools and eucalyptus (returns IDw8IEZPTyA- instead of FOO ) Succeeds with proposed euca2ools and proposed eucalyptus. Regression potential: The regression potential is small, since userdata is not really usable right now. In euca2ools, only someone relying on the bug (and base64_decoding the userdata in the cloud image itself) would be affected. Regression potential is slightly higher on eucalyptus side, since the fix is about escaping special characters in userdata. Careful testing with various userdata strings (to hit the special characters in the urlsafe-base64-encoded string) is necessary. = Karmic release notes: user-data not usable by guest instances Starting an instance with euca-run-instances and user-data (either using the -d, --user-data option or the -f, --user-data-file option) will store the user data in base64 encoding. Accessing the user data from the instance at http://169.254.169.254/latest/user-data will return the user data in base64 encoding. Because of this bug ec2-init is unable make use of user-data. In order to use this data it must first be decoded. A fix for this issue is expected to be provided in a post- release update immediately after the Ubuntu 9.10 release. == ** Changed in: euca2ools (Ubuntu) Assignee: Scott Moser (smoser) = Thierry Carrez (ttx) -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
This bug was fixed in the package euca2ools - 1.0+bzr20091007-0ubuntu2 --- euca2ools (1.0+bzr20091007-0ubuntu2) lucid; urgency=low [ Scott Moser ] * Do not base64 encode user-data in euca-run-instances, as boto takes care of that (LP: #461156) -- Thierry Carrez thierry.car...@ubuntu.com Wed, 02 Dec 2009 10:08:14 +0100 ** Changed in: euca2ools (Ubuntu) Status: In Progress = Fix Released -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Branch linked: lp:ubuntu/euca2ools -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus (Ubuntu Karmic) Status: In Progress = Fix Committed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Eucalyptus part of the fix now committed to lp:~ubuntu-core- dev/eucalyptus/ubuntu-karmic -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus (Ubuntu) Assignee: Thierry Carrez (ttx) = Dustin Kirkland (kirkland) -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Branch linked: lp:~ubuntu-core-dev/eucalyptus/ubuntu -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
This bug was fixed in the package eucalyptus - 1.6.1~bzr1083-0ubuntu1 --- eucalyptus (1.6.1~bzr1083-0ubuntu1) lucid; urgency=low [ Dustin Kirkland ] * Merge upstream bzr revision 1082; the following bugs have been fixed upstream since the last merge: - LP: #378969 - private bug - LP: #404842 - init script fix - LP: #434283 - existing keys should be overwritten unconditionally - LP: #445990 - run instance will fail if no kernel or ramdisk specified - LP: #447457 - euca_conf --register-sc ... check the number of parameters - LP: #449874 - fix incorrect help text (--delete-nodes doesn't exist) - LP: #451795 - show registered images in elastic fox - LP: #454405 - return correct networkIndex values on describeInstances - LP: #456877 - init script fix - LP: #456878 - fix for libvirt xen driver - LP: #460085 - fix rampart memory leak - LP: #461156 - fix authentication problem w/ userdata - LP: #461394 - fix multiple concurrent snapshots on the same volume - LP: #461444 - fix memory leaks in NC getConsoleOutput and startup_thread - LP: #469984 - fix iptables rules issue - LP: #46 - fix query string authentication - LP: #480783 - allow api connection over https - LP: #482249 - fix Describe Regions - LP: #484217 - create keypair should return an error if key exists - LP: #490623 - parse RFC 1123 formatted datetime * debian/control: - make all package lists one-per-line (makes changes henceforth more readable), sort lists - depend on rampart = 1.3.0-0ubuntu6, which fixes some shared library installation issues * debian/patches/04-axis2c-1.6.0-rampart-1.3.0.patch: drop this patch, since Eucalyptus 1.6.1 natively supports axis2c 1.6.0 now * debian/eucalyptus-cloud.install, debian/eucalyptus-common.eucalyptus.upstart, debian/eucalyptus-java-common.install, debian/eucalyptus-sc.install, debian/eucalyptus-walrus.install: update static version number strings from 1.6-devel to 1.6.1; (we should really find a better way to do this) * debian/patches/03-DESTDIR.patch: ported forward for merge -- Dustin Kirkland kirkl...@ubuntu.com Tue, 01 Dec 2009 21:09:28 -0600 ** Changed in: eucalyptus (Ubuntu) Status: In Progress = Fix Released -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Branch linked: lp:ubuntu/eucalyptus -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus (Ubuntu Karmic) Status: Confirmed = In Progress ** Changed in: eucalyptus (Ubuntu) Status: Confirmed = In Progress -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Branch linked: lp:~ttx/eucalyptus/karmic-sru2 -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Fix committed to lp:~ttx/eucalyptus/karmic-sru2 Test with: eucalyptus 1.6~bzr931-0ubuntu7.4~ppa1 in https://launchpad.net/~ttx/+archive/ppa With patched euca2ools (from smoser PPA) and patched eucalyptus (from ttx PPA): Test A : PASS Test B : PASS -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
revno: 1079 committer: decker dec...@personal-army branch nick: 1.6 timestamp: Fri 2009-11-20 23:33:29 -0800 message: fixes authentication problem w/ userdata lp:#461156 ** Changed in: eucalyptus Status: Incomplete = Fix Committed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
@Thierry - #21 the change of + is only for the purposes of computing the hmac, not processing the message contents. - #23 the bug referenced is not related to this issue. There look to be (at least) two issues here: 1) double base64'd data 2) authentication failure w/ certain user data strings #1 was fixed in the euca2ools, afaict. #2 no longer manifests with any of the examples listed in this thread. Is there still a pending issue here and, if so, is there a test case? cheers. chris -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus Status: Confirmed = Incomplete -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Thierry/Scott- Are there proposed fixes for this issue, at this point? -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus (Ubuntu) Assignee: Dustin Kirkland (kirkland) = Thierry Carrez (ttx) ** Changed in: eucalyptus (Ubuntu) Milestone: karmic-updates = None ** Changed in: eucalyptus (Ubuntu Karmic) Assignee: Dustin Kirkland (kirkland) = Thierry Carrez (ttx) ** Changed in: euca2ools (Ubuntu) Milestone: karmic-updates = None ** Tags added: eucalyptus -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
The eucalyptus part of this bug might well be bug 46. -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Test case A: A1 euca-run-instances -k $MYKEY --user-data FOO $EMI -t c1.medium A2 ssh -i $MYKEYPRIV ubu...@$ip 'wget -q http://169.254.169.254/latest/user-data -O -'; echo Expected results: A2 should return FOO Test case B: B1 euca-run-instances -k $MYKEY --user-data FOO $EMI -t c1.medium B2 ssh -i $MYKEYPRIV ubu...@$ip 'wget -q http://169.254.169.254/latest/user-data -O -'; echo Expected results: B2 should return FOO With unpatched euca2ools and unpatched eucalyptus: Test A fails with A2 returning Rk9P instead of FOO Test B fails with B2 returning IDw8IEZPTyA- instead of FOO With patched euca2ools (from smoser PPA) and unpatched eucalyptus: Test A : PASS Test B fails with B1 returning 403 Forbidden Note that python-boto does encode UserData using base64.b64encode (not urlsafe_b64encode as suggested in comment 13). The 403 Forbidden issue probably comes from URL decoding hitting special characters in HmacV2Handler.java, since they are no longer protected by double base64 encoding. Usage of canonicalString.replaceAll(\\+,%20) in there seems particularly relevant, since FOO translates to IDw8IEZPTyA+ -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: ubuntu-release-notes Assignee: (unassigned) = Scott Moser (smoser) -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: ubuntu-release-notes Status: New = Confirmed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
To fix this issue an SRU is needed for karmic: 1. fix euca-run-instances to only encode user-data once to mimic what ec2-run-instances does 2. fix eucalyptus soap|rest interface to not fail when user-data is sent by euca-run-instances. ** Description changed: User data supplied using euca-run-instances --user-data-file is not decoded before being presented to the instance. Inside the instance, curl http://169.254.169.254/latest/user-data; should fetch the decoded user data, whereas eucalyptus will return a base64 and url encoded string. This breaks ec2-run-user-data from the ec2-init package, rendering instance configuration using the user-data mechanism unusable. EC2 documentation at http://docs.amazonwebservices.com/AWSEC2/2007-03-01/DeveloperGuide/AESDG-chapter-instancedata.html states that EC2 will return decoded data (i don't have a ec2 account so i can't confirm this): The user data must be base64-encoded before being submitted to the API. The API command-line tools perform the base64-encoding for you. The data will be base64 decoded before being presented to the instance. + + = + Karmic release notes: + + user-data not usable by guest instances + + Starting an instance with euca-run-instances and user-data (either using + the -d option the -f option) will store the user data in base64 + encoding. Accessing the user data from the instance at + http://169.254.169.254/latest/user-data will return the user data in + base64 encoding. Because of this bug ec2-init is unable make use of + user-data. In order to use this data it must first be decoded. A fix for + this issue is expected to be provided in a post-release update + immediately after the Ubuntu 9.10 release. + + == ** Changed in: ubuntu-release-notes Status: Confirmed = In Progress -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Description changed: User data supplied using euca-run-instances --user-data-file is not decoded before being presented to the instance. Inside the instance, curl http://169.254.169.254/latest/user-data; should fetch the decoded user data, whereas eucalyptus will return a base64 and url encoded string. This breaks ec2-run-user-data from the ec2-init package, rendering instance configuration using the user-data mechanism unusable. EC2 documentation at http://docs.amazonwebservices.com/AWSEC2/2007-03-01/DeveloperGuide/AESDG-chapter-instancedata.html states that EC2 will return decoded data (i don't have a ec2 account so i can't confirm this): The user data must be base64-encoded before being submitted to the API. The API command-line tools perform the base64-encoding for you. The data will be base64 decoded before being presented to the instance. = Karmic release notes: user-data not usable by guest instances Starting an instance with euca-run-instances and user-data (either using - the -d option the -f option) will store the user data in base64 - encoding. Accessing the user data from the instance at - http://169.254.169.254/latest/user-data will return the user data in - base64 encoding. Because of this bug ec2-init is unable make use of - user-data. In order to use this data it must first be decoded. A fix for - this issue is expected to be provided in a post-release update - immediately after the Ubuntu 9.10 release. + the -d, --user-data option or the -f, --user-data-file option) will + store the user data in base64 encoding. Accessing the user data from + the instance at http://169.254.169.254/latest/user-data will return the + user data in base64 encoding. Because of this bug ec2-init is unable + make use of user-data. In order to use this data it must first be + decoded. A fix for this issue is expected to be provided in a post- + release update immediately after the Ubuntu 9.10 release. == ** Changed in: ubuntu-release-notes Status: In Progress = Fix Committed -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
** Changed in: eucalyptus Assignee: (unassigned) = chris grzegorczyk (chris-grze) -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 461156] Re: User data is not parsed correctly by Eucalyptus in some cases
Documented at https://wiki.ubuntu.com/KarmicKoala/ReleaseNotes#UEC %20user-data%20not%20usable%20by%20guest%20instances: When user data is passed to an instance started with {{{euca-run- instances}}} (using either the {{{-d}}}, {{{--user-data}}} option or the {{{-f}}}, {{{--user-data-file}}} option), the data returned at {{{http://169.254.169.254/latest/user-data}}} will be base64-encoded. {{{ec2-init}}} is unable make use of this user data because it must be decoded before use. A fix for this issue is expected to be provided in a post-release update immediately after the Ubuntu 9.10 release. (Bug:461156) ** Changed in: ubuntu-release-notes Status: Fix Committed = Fix Released -- User data is not parsed correctly by Eucalyptus in some cases https://bugs.launchpad.net/bugs/461156 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs