Re: RadosGW problems with copy in s3

2012-03-26 Thread Sławomir Skowron
After some tests. PUT/GET/DELETE via Radosgw now in version 0.44 works much better. End of this topic. Thanks. 2012/3/6 Sławomir Skowron : > On 6 mar 2012, at 18:53, Yehuda Sadeh Weinraub > wrote: > >> On Tue, Mar 6, 2012 at 2:08 AM, Sławomir Skowron wrote: >> >>> All logs from osd.24, osd.62,

Re: RadosGW problems with copy in s3

2012-03-06 Thread Sławomir Skowron
On 6 mar 2012, at 18:53, Yehuda Sadeh Weinraub wrote: > On Tue, Mar 6, 2012 at 2:08 AM, Sławomir Skowron wrote: > >> All logs from osd.24, osd.62, and osd.36 with osd debug =20 and >> filestore debug = 20 from 2012-03-06 10:25 and more. >> >> http://217.144.195.170/ceph/osd.24.log.tar.gz (348M

Re: RadosGW problems with copy in s3

2012-03-06 Thread Yehuda Sadeh Weinraub
On Tue, Mar 6, 2012 at 2:08 AM, Sławomir Skowron wrote: > All logs from osd.24, osd.62, and osd.36 with osd debug =20 and > filestore debug = 20 from 2012-03-06 10:25 and more. > > http://217.144.195.170/ceph/osd.24.log.tar.gz   (348MB) - machine 1 - rack1 > http://217.144.195.170/ceph/osd.36.log

Re: RadosGW problems with copy in s3

2012-03-06 Thread Sławomir Skowron
2012/3/5 Sławomir Skowron : > On 5 mar 2012, at 19:59, Yehuda Sadeh Weinraub > wrote: > >> On Mon, Mar 5, 2012 at 2:23 AM, Sławomir Skowron >> wrote: >>> 2012/3/1 Sławomir Skowron : 2012/2/29 Yehuda Sadeh Weinraub : > On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron > wrote: >>

Re: RadosGW problems with copy in s3

2012-03-05 Thread Sławomir Skowron
On 5 mar 2012, at 19:59, Yehuda Sadeh Weinraub wrote: > On Mon, Mar 5, 2012 at 2:23 AM, Sławomir Skowron > wrote: >> 2012/3/1 Sławomir Skowron : >>> 2012/2/29 Yehuda Sadeh Weinraub : On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron wrote: > > Ok, it's intentional. > >

Re: RadosGW problems with copy in s3

2012-03-05 Thread Yehuda Sadeh Weinraub
On Mon, Mar 5, 2012 at 2:23 AM, Sławomir Skowron wrote: > 2012/3/1 Sławomir Skowron : >> 2012/2/29 Yehuda Sadeh Weinraub : >>> On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron >>> wrote: Ok, it's intentional. We are checking meta info about files, then, checking md5 of file >

Re: RadosGW problems with copy in s3

2012-03-05 Thread Sławomir Skowron
2012/3/1 Sławomir Skowron : > 2012/2/29 Yehuda Sadeh Weinraub : >> On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron >> wrote: >>> >>> Ok, it's intentional. >>> >>> We are checking meta info about files, then, checking md5 of file >>> content. In parallel, updating object that have change, and the

Re: RadosGW problems with copy in s3

2012-02-29 Thread Yehuda Sadeh Weinraub
On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron wrote: > > Ok, it's intentional. > > We are checking meta info about files, then, checking md5 of file > content. In parallel, updating object that have change, and then > archiving this objects in another key, and last thing is deleting > objects

Re: RadosGW problems with copy in s3

2012-02-29 Thread Sławomir Skowron
Ok, it's intentional. We are checking meta info about files, then, checking md5 of file content. In parallel, updating object that have change, and then archiving this objects in another key, and last thing is deleting objects that expires. This happens over and over, because, this site is changi

Re: RadosGW problems with copy in s3

2012-02-28 Thread Yehuda Sadeh Weinraub
(resending to list) On Tue, Feb 28, 2012 at 11:53 AM, Sławomir Skowron wrote: > > 2012/2/28 Yehuda Sadeh Weinraub : > > On Tue, Feb 28, 2012 at 3:43 AM, Sławomir Skowron > > wrote: > >> After some parallel copy command via botto for many files everything, > >> going to slow down, and eventualy g

Re: RadosGW problems with copy in s3

2012-02-28 Thread Yehuda Sadeh Weinraub
On Tue, Feb 28, 2012 at 3:43 AM, Sławomir Skowron wrote: > After some parallel copy command via botto for many files everything, > going to slow down, and eventualy got timeout from nginx@radosgw. > > # ceph -s > 2012-02-28 12:16:57.818566    pg v20743: 8516 pgs: 8516 active+clean; > 2154 MB data,

RadosGW problems with copy in s3

2012-02-28 Thread Sławomir Skowron
After some parallel copy command via botto for many files everything, going to slow down, and eventualy got timeout from nginx@radosgw. # ceph -s 2012-02-28 12:16:57.818566pg v20743: 8516 pgs: 8516 active+clean; 2154 MB data, 53807 MB used, 20240 GB / 21379 GB avail 2012-02-28 12:16:57.845274