[jira] [Commented] (LIBCLOUD-978) Libcloud issues tracker: list of releases needs updating

[Quentin Pradet (JIRA)]

[ 
https://issues.apache.org/jira/browse/LIBCLOUD-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342465#comment-16342465
 ] 

Quentin Pradet commented on LIBCLOUD-978:
-

Agreed. As a committer, I don't have any rights on Jira so there's nothing I 
can do. [~kami], can you help?

> Libcloud issues tracker: list of releases needs updating
> 
>
> Key: LIBCLOUD-978
> URL: https://issues.apache.org/jira/browse/LIBCLOUD-978
> Project: Libcloud
>  Issue Type: Bug
>Reporter: Adam Wight
>Priority: Minor
>   Original Estimate: 0.5h
>  Remaining Estimate: 0.5h
>
> The list of releases in Jira is about 4 years out of date.  This makes the 
> project look stale when it's not, and makes it impossible to fill out the 
> "affects version" and "fix version" fields correctly.
> See 
> [https://issues.apache.org/jira/projects/LIBCLOUD?selectedItem=com.atlassian.jira.jira-projects-plugin%3Arelease-page=unreleased]
> Fixing will require someone with Jira permissions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (LIBCLOUD-977) Implement DigitalOcean's rebuild and resize commands

[Adam Wight (JIRA)]

 [ 
https://issues.apache.org/jira/browse/LIBCLOUD-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Wight updated LIBCLOUD-977:

Attachment: 0001-LIBCLOUD-977-Adds-rebuild-and-resize-commands-for-Di.patch

> Implement DigitalOcean's rebuild and resize commands
> 
>
> Key: LIBCLOUD-977
> URL: https://issues.apache.org/jira/browse/LIBCLOUD-977
> Project: Libcloud
>  Issue Type: New Feature
>  Components: Compute
>Reporter: Adam Wight
>Priority: Minor
>  Labels: pull-request-available
> Attachments: 
> 0001-LIBCLOUD-977-Adds-rebuild-and-resize-commands-for-Di.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> I'd like to add "ex_" driver functions for DigitalOcean's rebuild and resize 
> APIs, because I've switched to using libcloud and these are part of my 
> workflow.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (LIBCLOUD-977) Implement DigitalOcean's rebuild and resize commands

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/LIBCLOUD-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342269#comment-16342269
 ] 

ASF GitHub Bot commented on LIBCLOUD-977:
-

Github user adamwight closed the pull request at:

https://github.com/apache/libcloud/pull/1169


> Implement DigitalOcean's rebuild and resize commands
> 
>
> Key: LIBCLOUD-977
> URL: https://issues.apache.org/jira/browse/LIBCLOUD-977
> Project: Libcloud
>  Issue Type: New Feature
>  Components: Compute
>Reporter: Adam Wight
>Priority: Minor
>  Labels: pull-request-available
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> I'd like to add "ex_" driver functions for DigitalOcean's rebuild and resize 
> APIs, because I've switched to using libcloud and these are part of my 
> workflow.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] libcloud pull request #1169: [LIBCLOUD-977] Adds rebuild and resize commands...

[adamwight]

Github user adamwight closed the pull request at:

https://github.com/apache/libcloud/pull/1169


---

[jira] [Updated] (LIBCLOUD-979) libcloud.storage / S3_RGW: cannot fetch some objects

[Jack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/LIBCLOUD-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jack updated LIBCLOUD-979:
--
Description: 
Libcloud cannot handle some legitimates objects
 Here is an example, that will explain the issue

Please check this code:
{quote}from libcloud.storage.types import Provider
 from libcloud.storage.providers import get_driver

driver = get_driver(Provider.S3_RGW)(key='access_key', secret='secret_key', 
host='hostname')

print(driver.get_object('tilde', 'file~'))
{quote}
 

Output:
{quote}~$ ./test.py 
 Traceback (most recent call last):
 File "./test.py", line 8, in 
 print(driver.get_object('tilde', 'file~'))
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 332, in get_object
 response = self.connection.request(object_path, method='HEAD')
 File "/tmp/libcloud/libcloud/common/base.py", line 637, in request
 response = responseCls(**kwargs)
 File "/tmp/libcloud/libcloud/common/base.py", line 152, in __init__
 message=self.parse_error(),
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 96, in parse_error
 raise InvalidCredsError(self.body)
 libcloud.common.types.InvalidCredsError: ''
{quote}
 

A tcpdump shows that libcloud tranforms the key from "file~" to "file%7E" 
(thus, url-encode)

The slight patch below fixes this issue:
{quote}diff --git a/libcloud/storage/drivers/s3.py 
b/libcloud/storage/drivers/s3.py
 index f9f4b6c9..7107a8c6 100644
 — a/libcloud/storage/drivers/s3.py
 +++ b/libcloud/storage/drivers/s3.py
 @@ -366,7 +366,7 @@ class BaseS3StorageDriver(StorageDriver):
 :rtype: ``str``
 """
 container_url = self._get_container_path(container)

- object_name_cleaned = self._clean_object_name(object_name)
 + object_name_cleaned = object_name
 object_path = '%s/%s' % (container_url, object_name_cleaned)
 return object_path

@@ -776,9 +776,6 @@ class BaseS3StorageDriver(StorageDriver):
 delimiter=None):
 self._abort_multipart(container, upload.key, upload.id)

- def _clean_object_name(self, name):

-     name = urlquote(name)

-     return name

def _put_object(self, container, object_name, method='PUT',
 query_args=None, extra=None, file_path=None,

~$ ./test.py 
 
{quote}
 

This kind of issues existed on other projects (see 
[https://github.com/aws/aws-sdk-php/issues/37] and 
[https://github.com/aws/aws-sdk-go/issues/45] for instance)

I do not know if this is specific to Ceph, or if this issue applies to amazon's 
S3 as well (regarding the issues above, this seems to be)

 

Thanks

  was:
Libcloud cannot handle some legitimates objects
 Here is an example, that will explain the issue

Please check this code:
{quote}from libcloud.storage.types import Provider
 from libcloud.storage.providers import get_driver

driver = get_driver(Provider.S3_RGW)(key='access_key', secret='secret_key', 
host='hostname')

print(driver.get_object('tilde', 'file~'))
{quote}
 

Output:
{quote}~$ ./test.py 
 Traceback (most recent call last):
 File "./test.py", line 8, in 
 print(driver.get_object('tilde', 'file~'))
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 332, in get_object
 response = self.connection.request(object_path, method='HEAD')
 File "/tmp/libcloud/libcloud/common/base.py", line 637, in request
 response = responseCls(**kwargs)
 File "/tmp/libcloud/libcloud/common/base.py", line 152, in __init__
 message=self.parse_error(),
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 96, in parse_error
 raise InvalidCredsError(self.body)
 libcloud.common.types.InvalidCredsError: ''
{quote}
 

A tcpdump shows that libcloud tranforms the key from "file~" to "file%7E" 
(thus, url-encode)

The slight patch below fixes this issue:
{quote}diff --git a/libcloud/storage/drivers/s3.py 
b/libcloud/storage/drivers/s3.py
 index f9f4b6c9..7107a8c6 100644
 — a/libcloud/storage/drivers/s3.py
 +++ b/libcloud/storage/drivers/s3.py
 @@ -366,7 +366,7 @@ class BaseS3StorageDriver(StorageDriver):
 :rtype: ``str``
 """
 container_url = self._get_container_path(container)
 - object_name_cleaned = self._clean_object_name(object_name)
 + object_name_cleaned = object_name
 object_path = '%s/%s' % (container_url, object_name_cleaned)
 return object_path

@@ -776,9 +776,6 @@ class BaseS3StorageDriver(StorageDriver):
 delimiter=None):
 self._abort_multipart(container, upload.key, upload.id)
 - def _clean_object_name(self, name):
 - name = urlquote(name)
 - return name

def _put_object(self, container, object_name, method='PUT',
 query_args=None, extra=None, file_path=None,

~$ ./test.py 
 
{quote}
 

This kind of issues existed on other projects (see 
[https://github.com/aws/aws-sdk-php/issues/37] and 
[https://github.com/aws/aws-sdk-go/issues/45] for instance)

I do not know if this is specific to Ceph, or if this issue applies to amazon's 
S3 as well (regarding the issues above, this seems to be)

 

Thanks


> libcloud.storage / S3_RGW: cannot fetch some objects
> 

[jira] [Created] (LIBCLOUD-979) libcloud.storage / S3_RGW: cannot fetch some objects

[Jack (JIRA)]

Jack created LIBCLOUD-979:
-

 Summary: libcloud.storage / S3_RGW: cannot fetch some objects
 Key: LIBCLOUD-979
 URL: https://issues.apache.org/jira/browse/LIBCLOUD-979
 Project: Libcloud
  Issue Type: Bug
  Components: Storage
 Environment:  The issue have been encountered on libcloud 2.2.1, as 
well as trunk (last commit: aaf15742f4efac7947a2f47e6e140303dc8ec2d2)
Reporter: Jack


Libcloud cannot handle some legitimates object
 Here is an example, that will explain the issue

Please check this code:
{quote}from libcloud.storage.types import Provider
 from libcloud.storage.providers import get_driver

driver = get_driver(Provider.S3_RGW)(key='access_key', secret='secret_key', 
host='hostname')

print(driver.get_object('tilde', 'file~'))
{quote}
 

Output:
{quote}~$ ./test.py 
Traceback (most recent call last):
 File "./test.py", line 8, in 
 print(driver.get_object('tilde', 'file~'))
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 332, in get_object
 response = self.connection.request(object_path, method='HEAD')
 File "/tmp/libcloud/libcloud/common/base.py", line 637, in request
 response = responseCls(**kwargs)
 File "/tmp/libcloud/libcloud/common/base.py", line 152, in __init__
 message=self.parse_error(),
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 96, in parse_error
 raise InvalidCredsError(self.body)
libcloud.common.types.InvalidCredsError: ''
{quote}
 

A tcpdump shows that libcloud tranforms the key from "file~" to "file%7E" 
(thus, url-encode)

The slight patch below fixes this issue:
{quote}diff --git a/libcloud/storage/drivers/s3.py 
b/libcloud/storage/drivers/s3.py
index f9f4b6c9..7107a8c6 100644
--- a/libcloud/storage/drivers/s3.py
+++ b/libcloud/storage/drivers/s3.py
@@ -366,7 +366,7 @@ class BaseS3StorageDriver(StorageDriver):
 :rtype: ``str``
 """
 container_url = self._get_container_path(container)
- object_name_cleaned = self._clean_object_name(object_name)
+ object_name_cleaned = object_name
 object_path = '%s/%s' % (container_url, object_name_cleaned)
 return object_path

@@ -776,9 +776,6 @@ class BaseS3StorageDriver(StorageDriver):
 delimiter=None):
 self._abort_multipart(container, upload.key, upload.id)

- def _clean_object_name(self, name):
- name = urlquote(name)
- return name

 def _put_object(self, container, object_name, method='PUT',
 query_args=None, extra=None, file_path=None,

~$ ./test.py 

{quote}
 

This kind of issues existed on other projects (see 
[https://github.com/aws/aws-sdk-php/issues/37] and 
[https://github.com/aws/aws-sdk-go/issues/45] for instance)

I do not know if this is specific to Ceph, or if this issue applies to amazon's 
S3 as well (regarding the issues above, this seems to be)

 

Thanks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (LIBCLOUD-979) libcloud.storage / S3_RGW: cannot fetch some objects

[Jack (JIRA)]

 [ 
https://issues.apache.org/jira/browse/LIBCLOUD-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jack updated LIBCLOUD-979:
--
Description: 
Libcloud cannot handle some legitimates objects
 Here is an example, that will explain the issue

Please check this code:
{quote}from libcloud.storage.types import Provider
 from libcloud.storage.providers import get_driver

driver = get_driver(Provider.S3_RGW)(key='access_key', secret='secret_key', 
host='hostname')

print(driver.get_object('tilde', 'file~'))
{quote}
 

Output:
{quote}~$ ./test.py 
 Traceback (most recent call last):
 File "./test.py", line 8, in 
 print(driver.get_object('tilde', 'file~'))
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 332, in get_object
 response = self.connection.request(object_path, method='HEAD')
 File "/tmp/libcloud/libcloud/common/base.py", line 637, in request
 response = responseCls(**kwargs)
 File "/tmp/libcloud/libcloud/common/base.py", line 152, in __init__
 message=self.parse_error(),
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 96, in parse_error
 raise InvalidCredsError(self.body)
 libcloud.common.types.InvalidCredsError: ''
{quote}
 

A tcpdump shows that libcloud tranforms the key from "file~" to "file%7E" 
(thus, url-encode)

The slight patch below fixes this issue:
{quote}diff --git a/libcloud/storage/drivers/s3.py 
b/libcloud/storage/drivers/s3.py
 index f9f4b6c9..7107a8c6 100644
 — a/libcloud/storage/drivers/s3.py
 +++ b/libcloud/storage/drivers/s3.py
 @@ -366,7 +366,7 @@ class BaseS3StorageDriver(StorageDriver):
 :rtype: ``str``
 """
 container_url = self._get_container_path(container)
 - object_name_cleaned = self._clean_object_name(object_name)
 + object_name_cleaned = object_name
 object_path = '%s/%s' % (container_url, object_name_cleaned)
 return object_path

@@ -776,9 +776,6 @@ class BaseS3StorageDriver(StorageDriver):
 delimiter=None):
 self._abort_multipart(container, upload.key, upload.id)
 - def _clean_object_name(self, name):
 - name = urlquote(name)
 - return name

def _put_object(self, container, object_name, method='PUT',
 query_args=None, extra=None, file_path=None,

~$ ./test.py 
 
{quote}
 

This kind of issues existed on other projects (see 
[https://github.com/aws/aws-sdk-php/issues/37] and 
[https://github.com/aws/aws-sdk-go/issues/45] for instance)

I do not know if this is specific to Ceph, or if this issue applies to amazon's 
S3 as well (regarding the issues above, this seems to be)

 

Thanks

  was:
Libcloud cannot handle some legitimates object
 Here is an example, that will explain the issue

Please check this code:
{quote}from libcloud.storage.types import Provider
 from libcloud.storage.providers import get_driver

driver = get_driver(Provider.S3_RGW)(key='access_key', secret='secret_key', 
host='hostname')

print(driver.get_object('tilde', 'file~'))
{quote}
 

Output:
{quote}~$ ./test.py 
Traceback (most recent call last):
 File "./test.py", line 8, in 
 print(driver.get_object('tilde', 'file~'))
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 332, in get_object
 response = self.connection.request(object_path, method='HEAD')
 File "/tmp/libcloud/libcloud/common/base.py", line 637, in request
 response = responseCls(**kwargs)
 File "/tmp/libcloud/libcloud/common/base.py", line 152, in __init__
 message=self.parse_error(),
 File "/tmp/libcloud/libcloud/storage/drivers/s3.py", line 96, in parse_error
 raise InvalidCredsError(self.body)
libcloud.common.types.InvalidCredsError: ''
{quote}
 

A tcpdump shows that libcloud tranforms the key from "file~" to "file%7E" 
(thus, url-encode)

The slight patch below fixes this issue:
{quote}diff --git a/libcloud/storage/drivers/s3.py 
b/libcloud/storage/drivers/s3.py
index f9f4b6c9..7107a8c6 100644
--- a/libcloud/storage/drivers/s3.py
+++ b/libcloud/storage/drivers/s3.py
@@ -366,7 +366,7 @@ class BaseS3StorageDriver(StorageDriver):
 :rtype: ``str``
 """
 container_url = self._get_container_path(container)
- object_name_cleaned = self._clean_object_name(object_name)
+ object_name_cleaned = object_name
 object_path = '%s/%s' % (container_url, object_name_cleaned)
 return object_path

@@ -776,9 +776,6 @@ class BaseS3StorageDriver(StorageDriver):
 delimiter=None):
 self._abort_multipart(container, upload.key, upload.id)

- def _clean_object_name(self, name):
- name = urlquote(name)
- return name

 def _put_object(self, container, object_name, method='PUT',
 query_args=None, extra=None, file_path=None,

~$ ./test.py 

{quote}
 

This kind of issues existed on other projects (see 
[https://github.com/aws/aws-sdk-php/issues/37] and 
[https://github.com/aws/aws-sdk-go/issues/45] for instance)

I do not know if this is specific to Ceph, or if this issue applies to amazon's 
S3 as well (regarding the issues above, this seems to be)

 

Thanks


> libcloud.storage / S3_RGW: cannot fetch some objects
> 
>
>