Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-08 Thread Patrycja Szabłowska
Thank you Josh,

I'm not sure if this is ceph's fault or perhaps FastCGI's or Boto's.
When trying to upload 10KB chunk I've had those mysterious FastCGI's
errors on server side and boto.exception.BotoServerError:
BotoServerError: 500 Internal Server Error on client side.
I've tried now to upload 4MB part - the error on client's side was as
expected EntityTooSmall - but returned at the end, when I've called
the method complete_upload.

Perhaps this output can be helpful to someone:

$ python boto_multi.py
  begin upload of Bosphorus_1920x1080_30fps_420_8bit_AVC_MP4.mp4
  size 7507998, 2 parts
upload part 1 size 4194304
upload part 2 size 3313694
  end upload
Traceback (most recent call last):
  File "boto_multi.py", line 48, in 
part.complete_upload()
  File "local/lib/python2.7/site-packages/boto/s3/multipart.py", line
319, in complete_upload
self.id, xml)
  File "local/lib/python2.7/site-packages/boto/s3/bucket.py", line
1779, in complete_multipart_upload
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 400 Bad Request
EntityTooSmall


Cheers,

Patrycja Szabłowska





2014-07-08 0:10 GMT+02:00 Josh Durgin :
> On 07/07/2014 05:41 AM, Patrycja Szabłowska wrote:
>>
>> OK, the mystery is solved.
>>
>>  From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html
>> "During a multi part upload you can't upload parts smaller than 5M"
>>
>> I've tried to upload smaller chunks, like 10KB. I've changed chunk size
>> to 5MB and it works now.
>>
>> It's a pity that the Ceph's docs don't mention the limit (or I couldn't
>> found it anywhere). And that the error wasn't helpful at all.
>
>
> Glad you figured it out. This is in the s3 docs [1], but the lack of
> error message is a regression. I added a couple tickets for this:
>
> http://tracker.ceph.com/issues/8764
> http://tracker.ceph.com/issues/8766
>
> Josh
>
> [1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-07 Thread Josh Durgin

On 07/07/2014 05:41 AM, Patrycja Szabłowska wrote:

OK, the mystery is solved.

 From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html
"During a multi part upload you can't upload parts smaller than 5M"

I've tried to upload smaller chunks, like 10KB. I've changed chunk size
to 5MB and it works now.

It's a pity that the Ceph's docs don't mention the limit (or I couldn't
found it anywhere). And that the error wasn't helpful at all.


Glad you figured it out. This is in the s3 docs [1], but the lack of
error message is a regression. I added a couple tickets for this:

http://tracker.ceph.com/issues/8764
http://tracker.ceph.com/issues/8766

Josh

[1] http://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadUploadPart.html
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-07 Thread Patrycja Szabłowska
OK, the mystery is solved.

>From https://www.mail-archive.com/ceph-users@lists.ceph.com/msg10368.html
"During a multi part upload you can't upload parts smaller than 5M"

I've tried to upload smaller chunks, like 10KB. I've changed chunk size to
5MB and it works now.

It's a pity that the Ceph's docs don't mention the limit (or I couldn't
found it anywhere). And that the error wasn't helpful at all.


Cheers,

Patrycja Szabłowska




2014-07-07 14:05 GMT+02:00 Patrycja Szabłowska <
szablowska.patry...@gmail.com>:

> I've installed Ubuntu 12.04 in order to test multiupload with the ceph's
> modified fastcgi (according to this:
> https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue
> ).
>
> The problem is still the same: I can initiate the multi part upload or
> upload single part, but when trying to put a part of multi part upload I
> get the error with Fastcgi as I've shown before.
>
>  Here's a part of the error log once again:
>
>
> ==> apache.error.log <==
> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
> failed
> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>
>
> It seems to me that it doesn't matter if I turn the rgw print continue on
> or off.
>
> I've got no idea what to try next to make it work... Are there any other
> pools needed to put parts in upload?
>
>
> Thanks,
>
> Patrycja Szabłowska
>
>
>
> 2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska <
> szablowska.patry...@gmail.com>:
>
> Still not sure do I need the ceph's modified fastcgi or not.
>> But I guess this explains my problem with the installation:
>> http://tracker.ceph.com/issues/8233
>>
>>
>> It would be nice to have at least a workaround for this...
>>
>> Thanks,
>>
>> Patrycja Szabłowska
>>
>>
>>
>> 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska <
>> szablowska.patry...@gmail.com>:
>>
>> Thank you Luis for your response.
>>>
>>> Quite unbelievable, but your solution worked!
>>> Unfortunately, I'm stuck again when trying to upload parts of the file.
>>>
>>> Apache's logs:
>>>
>>>
>>> ==> apache.access.log <==
>>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1"
>>> 200 477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
>>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
>>> /bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
>>> Python/2.7.6 Linux/3.13.0-30-generic"
>>>
>>> ==> apache.error.log <==
>>> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
>>> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
>>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>>>
>>> ==> apache.access.log <==
>>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
>>> /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
>>> HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
>>> Linux/3.13.0-30-generic"
>>>
>>> ==> apache.error.log <==
>>> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
>>> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
>>> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
>>> failed
>>> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
>>> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
>>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>>>
>>>
>>>
>>> I'm using the default fastcgi module, not the one provided by Ceph. I've
>>> tried installing it on my ubuntu 14.04, but unfortunately I keep getting
>>> the error:
>>>
>>> libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)
>>>
>>>
>>> Is the modified fastcgi module mandatory in order to use multi part
>>> upload?
>>>
>>>
>>> Thanks,
>>>
>>> Patrycja Szabłowska
>>>
>>>
>>> 2014-07-03 18:34 GMT+02:00 Luis Periquito :
>>>
 I was at this issue this morning. It seems radosgw requires you to have
 a pool named '' to work with multipart. I just created a pool with that
 name
 rados mkpool ''

 either that or allow the pool be created by the radosgw...


 On 3 July 2014 16:27, Patrycja Szabłowska <
 szablowska.patry...@gmail.com> wrote:

> Hi,
>
> I'm trying to make multi part upload work. I'm using ceph
> 0.80-702-g9bac31b (from the ceph's github).
>
> I've tried the code provided by Mark Kirkwood here:
>
>
> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>
>
> But unfortunately, it gives me the error:
>
> (m

Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-07 Thread Patrycja Szabłowska
I've installed Ubuntu 12.04 in order to test multiupload with the ceph's
modified fastcgi (according to this:
https://ceph.com/docs/master/install/install-ceph-gateway/#apache-fastcgi-w-100-continue
).

The problem is still the same: I can initiate the multi part upload or
upload single part, but when trying to put a part of multi part upload I
get the error with Fastcgi as I've shown before.

Here's a part of the error log once again:

==> apache.error.log <==
[Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"
[Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
(111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
failed
[Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"


It seems to me that it doesn't matter if I turn the rgw print continue on
or off.

I've got no idea what to try next to make it work... Are there any other
pools needed to put parts in upload?


Thanks,

Patrycja Szabłowska



2014-07-04 16:26 GMT+02:00 Patrycja Szabłowska <
szablowska.patry...@gmail.com>:

> Still not sure do I need the ceph's modified fastcgi or not.
> But I guess this explains my problem with the installation:
> http://tracker.ceph.com/issues/8233
>
>
> It would be nice to have at least a workaround for this...
>
> Thanks,
>
> Patrycja Szabłowska
>
>
>
> 2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska <
> szablowska.patry...@gmail.com>:
>
> Thank you Luis for your response.
>>
>> Quite unbelievable, but your solution worked!
>> Unfortunately, I'm stuck again when trying to upload parts of the file.
>>
>> Apache's logs:
>>
>>
>> ==> apache.access.log <==
>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" 200
>> 477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
>> /bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
>> Python/2.7.6 Linux/3.13.0-30-generic"
>>
>> ==> apache.error.log <==
>> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
>> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>>
>> ==> apache.access.log <==
>> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
>> /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
>> HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
>> Linux/3.13.0-30-generic"
>>
>> ==> apache.error.log <==
>> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
>> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
>> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
>> failed
>> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
>> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
>> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>>
>>
>>
>> I'm using the default fastcgi module, not the one provided by Ceph. I've
>> tried installing it on my ubuntu 14.04, but unfortunately I keep getting
>> the error:
>>
>> libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)
>>
>>
>> Is the modified fastcgi module mandatory in order to use multi part
>> upload?
>>
>>
>> Thanks,
>>
>> Patrycja Szabłowska
>>
>>
>> 2014-07-03 18:34 GMT+02:00 Luis Periquito :
>>
>>> I was at this issue this morning. It seems radosgw requires you to have
>>> a pool named '' to work with multipart. I just created a pool with that
>>> name
>>> rados mkpool ''
>>>
>>> either that or allow the pool be created by the radosgw...
>>>
>>>
>>> On 3 July 2014 16:27, Patrycja Szabłowska >> > wrote:
>>>
 Hi,

 I'm trying to make multi part upload work. I'm using ceph
 0.80-702-g9bac31b (from the ceph's github).

 I've tried the code provided by Mark Kirkwood here:


 http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


 But unfortunately, it gives me the error:

 (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
   begin upload of abc.yuv
   size 746496, 7 parts
 Traceback (most recent call last):
   File "boto_multi.py", line 36, in 
 part = bucket.initiate_multipart_upload(objname)
   File
 "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
 line 1742, in initiate_multipart_upload
 response.status, response.reason, body)
 boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
 >>> encoding="UTF-8"?>AccessDenied


 The single part upload works for me. I am able to create buckets and
 objects.
 I've tried also other similar examples, but none of 

Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-04 Thread Patrycja Szabłowska
Still not sure do I need the ceph's modified fastcgi or not.
But I guess this explains my problem with the installation:
http://tracker.ceph.com/issues/8233


It would be nice to have at least a workaround for this...

Thanks,

Patrycja Szabłowska



2014-07-04 16:02 GMT+02:00 Patrycja Szabłowska <
szablowska.patry...@gmail.com>:

> Thank you Luis for your response.
>
> Quite unbelievable, but your solution worked!
> Unfortunately, I'm stuck again when trying to upload parts of the file.
>
> Apache's logs:
>
>
> ==> apache.access.log <==
> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" 200
> 477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
> /bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
> Python/2.7.6 Linux/3.13.0-30-generic"
>
> ==> apache.error.log <==
> [Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
> 127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from
> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>
> ==> apache.access.log <==
> 127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
> /bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
> HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
> Linux/3.13.0-30-generic"
>
> ==> apache.error.log <==
> [Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
> (111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
> connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
> failed
> [Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
> 127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from
> server "/home/pszablow/ceph/src/htdocs/rgw.fcgi"
>
>
>
> I'm using the default fastcgi module, not the one provided by Ceph. I've
> tried installing it on my ubuntu 14.04, but unfortunately I keep getting
> the error:
>
> libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)
>
>
> Is the modified fastcgi module mandatory in order to use multi part upload?
>
>
> Thanks,
>
> Patrycja Szabłowska
>
>
> 2014-07-03 18:34 GMT+02:00 Luis Periquito :
>
>> I was at this issue this morning. It seems radosgw requires you to have a
>> pool named '' to work with multipart. I just created a pool with that name
>> rados mkpool ''
>>
>> either that or allow the pool be created by the radosgw...
>>
>>
>> On 3 July 2014 16:27, Patrycja Szabłowska 
>> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to make multi part upload work. I'm using ceph
>>> 0.80-702-g9bac31b (from the ceph's github).
>>>
>>> I've tried the code provided by Mark Kirkwood here:
>>>
>>>
>>> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>>>
>>>
>>> But unfortunately, it gives me the error:
>>>
>>> (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
>>>   begin upload of abc.yuv
>>>   size 746496, 7 parts
>>> Traceback (most recent call last):
>>>   File "boto_multi.py", line 36, in 
>>> part = bucket.initiate_multipart_upload(objname)
>>>   File
>>> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
>>> line 1742, in initiate_multipart_upload
>>> response.status, response.reason, body)
>>> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
>>> >> encoding="UTF-8"?>AccessDenied
>>>
>>>
>>> The single part upload works for me. I am able to create buckets and
>>> objects.
>>> I've tried also other similar examples, but none of them works.
>>>
>>>
>>> Any ideas what's wrong? Does the ceph's multi part upload actually
>>> work for anybody?
>>>
>>>
>>> Thanks,
>>>
>>> Patrycja Szabłowska
>>> ___
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>>
>>
>> --
>>
>> Luis Periquito
>>
>> Unix Engineer
>>
>> Ocado.com 
>>
>> Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
>> Hatfield, Herts AL10 9NE
>>
>> Notice:  This email is confidential and may contain copyright material of
>> members of the Ocado Group. Opinions and views expressed in this message
>> may not necessarily reflect the opinions and views of the members of the
>> Ocado Group.
>>
>> If you are not the intended recipient, please notify us immediately and
>> delete all copies of this message. Please note that it is your
>> responsibility to scan this message for viruses.
>>
>> References to the “Ocado Group” are to Ocado Group plc (registered in
>> England and Wales with number 7098618) and its subsidiary undertakings (as
>> that expression is defined in the Companies Act 2006) from time to time.
>> The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
>> Hatfield Business Park, Hatfield, Herts. AL10 9NE.
>>
>
>
>
> --
> Pozdrawiam
> Patrycja Szabłowska
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
h

Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-04 Thread Patrycja Szabłowska
Thank you Luis for your response.

Quite unbelievable, but your solution worked!
Unfortunately, I'm stuck again when trying to upload parts of the file.

Apache's logs:


==> apache.access.log <==
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT /bucketbig/ HTTP/1.1" 200
477 "{Referer}i" "Boto/2.30.0 Python/2.7.6 Linux/3.13.0-30-generic"
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "POST
/bucketbig/Bosphorus?uploads HTTP/1.1" 200 249 "{Referer}i" "Boto/2.30.0
Python/2.7.6 Linux/3.13.0-30-generic"

==> apache.error.log <==
[Fri Jul 04 15:40:41.868621 2014] [fastcgi:error] [pid 14199] [client
127.0.0.1:46571] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"

==> apache.access.log <==
127.0.0.1 l - [04/Jul/2014:15:40:41 +0200] "PUT
/bucketbig/Bosphorus?uploadId=2/fURJChPdpUqA3Z1oVLUjT7ROsnxIqZ9&partNumber=1
HTTP/1.1" 500 531 "{Referer}i" "Boto/2.30.0 Python/2.7.6
Linux/3.13.0-30-generic"

==> apache.error.log <==
[Fri Jul 04 15:40:42.571543 2014] [fastcgi:error] [pid 14200]
(111)Connection refused: [client 127.0.0.1:46572] FastCGI: failed to
connect to server "/home/pszablow/ceph/src/htdocs/rgw.fcgi": connect()
failed
[Fri Jul 04 15:40:42.571660 2014] [fastcgi:error] [pid 14200] [client
127.0.0.1:46572] FastCGI: incomplete headers (0 bytes) received from server
"/home/pszablow/ceph/src/htdocs/rgw.fcgi"



I'm using the default fastcgi module, not the one provided by Ceph. I've
tried installing it on my ubuntu 14.04, but unfortunately I keep getting
the error:
libapache2-mod-fastcgi : requires: apache2.2-common (>= 2.2.4)


Is the modified fastcgi module mandatory in order to use multi part upload?


Thanks,

Patrycja Szabłowska


2014-07-03 18:34 GMT+02:00 Luis Periquito :

> I was at this issue this morning. It seems radosgw requires you to have a
> pool named '' to work with multipart. I just created a pool with that name
> rados mkpool ''
>
> either that or allow the pool be created by the radosgw...
>
>
> On 3 July 2014 16:27, Patrycja Szabłowska 
> wrote:
>
>> Hi,
>>
>> I'm trying to make multi part upload work. I'm using ceph
>> 0.80-702-g9bac31b (from the ceph's github).
>>
>> I've tried the code provided by Mark Kirkwood here:
>>
>>
>> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>>
>>
>> But unfortunately, it gives me the error:
>>
>> (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
>>   begin upload of abc.yuv
>>   size 746496, 7 parts
>> Traceback (most recent call last):
>>   File "boto_multi.py", line 36, in 
>> part = bucket.initiate_multipart_upload(objname)
>>   File
>> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
>> line 1742, in initiate_multipart_upload
>> response.status, response.reason, body)
>> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
>> > encoding="UTF-8"?>AccessDenied
>>
>>
>> The single part upload works for me. I am able to create buckets and
>> objects.
>> I've tried also other similar examples, but none of them works.
>>
>>
>> Any ideas what's wrong? Does the ceph's multi part upload actually
>> work for anybody?
>>
>>
>> Thanks,
>>
>> Patrycja Szabłowska
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
>
> --
>
> Luis Periquito
>
> Unix Engineer
>
> Ocado.com 
>
> Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
> Hatfield, Herts AL10 9NE
>
> Notice:  This email is confidential and may contain copyright material of
> members of the Ocado Group. Opinions and views expressed in this message
> may not necessarily reflect the opinions and views of the members of the
> Ocado Group.
>
> If you are not the intended recipient, please notify us immediately and
> delete all copies of this message. Please note that it is your
> responsibility to scan this message for viruses.
>
> References to the “Ocado Group” are to Ocado Group plc (registered in
> England and Wales with number 7098618) and its subsidiary undertakings (as
> that expression is defined in the Companies Act 2006) from time to time.
> The registered office of Ocado Group plc is Titan Court, 3 Bishops Square,
> Hatfield Business Park, Hatfield, Herts. AL10 9NE.
>



-- 
Pozdrawiam
Patrycja Szabłowska
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-03 Thread Luis Periquito
I was at this issue this morning. It seems radosgw requires you to have a
pool named '' to work with multipart. I just created a pool with that name
rados mkpool ''

either that or allow the pool be created by the radosgw...


On 3 July 2014 16:27, Patrycja Szabłowska 
wrote:

> Hi,
>
> I'm trying to make multi part upload work. I'm using ceph
> 0.80-702-g9bac31b (from the ceph's github).
>
> I've tried the code provided by Mark Kirkwood here:
>
>
> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html
>
>
> But unfortunately, it gives me the error:
>
> (multitest)pszablow@pat-desktop:~/$ python boto_multi.py
>   begin upload of abc.yuv
>   size 746496, 7 parts
> Traceback (most recent call last):
>   File "boto_multi.py", line 36, in 
> part = bucket.initiate_multipart_upload(objname)
>   File
> "/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
> line 1742, in initiate_multipart_upload
> response.status, response.reason, body)
> boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
>  encoding="UTF-8"?>AccessDenied
>
>
> The single part upload works for me. I am able to create buckets and
> objects.
> I've tried also other similar examples, but none of them works.
>
>
> Any ideas what's wrong? Does the ceph's multi part upload actually
> work for anybody?
>
>
> Thanks,
>
> Patrycja Szabłowska
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



-- 

Luis Periquito

Unix Engineer

Ocado.com 

Head Office, Titan Court, 3 Bishop Square, Hatfield Business Park,
Hatfield, Herts AL10 9NE

-- 


Notice:  This email is confidential and may contain copyright material of 
members of the Ocado Group. Opinions and views expressed in this message 
may not necessarily reflect the opinions and views of the members of the 
Ocado Group.

If you are not the intended recipient, please notify us immediately and 
delete all copies of this message. Please note that it is your 
responsibility to scan this message for viruses.  

References to the “Ocado Group” are to Ocado Group plc (registered in 
England and Wales with number 7098618) and its subsidiary undertakings (as 
that expression is defined in the Companies Act 2006) from time to time.  
The registered office of Ocado Group plc is Titan Court, 3 Bishops Square, 
Hatfield Business Park, Hatfield, Herts. AL10 9NE.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] Multipart upload on ceph 0.8 doesn't work?

2014-07-03 Thread Patrycja Szabłowska
Hi,

I'm trying to make multi part upload work. I'm using ceph
0.80-702-g9bac31b (from the ceph's github).

I've tried the code provided by Mark Kirkwood here:

http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-October/034940.html


But unfortunately, it gives me the error:

(multitest)pszablow@pat-desktop:~/$ python boto_multi.py
  begin upload of abc.yuv
  size 746496, 7 parts
Traceback (most recent call last):
  File "boto_multi.py", line 36, in 
part = bucket.initiate_multipart_upload(objname)
  File 
"/home/pszablow/venvs/multitest/local/lib/python2.7/site-packages/boto/s3/bucket.py",
line 1742, in initiate_multipart_upload
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
AccessDenied


The single part upload works for me. I am able to create buckets and objects.
I've tried also other similar examples, but none of them works.


Any ideas what's wrong? Does the ceph's multi part upload actually
work for anybody?


Thanks,

Patrycja Szabłowska
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com