RE: Symbolic links like feature on radosgw

2015-11-03 Thread Zhou, Yuan
Hi Guang, Does 'copy' works for your case? copying one objects inside one bucket would copy the head object only. The shadow objects are not copied. If rgw_max_chunk_objects is configured to be small(say 1-byte) then we have a 'symbolic link' like file. thanks, -yuan -Original

nginx for rgw fcgi frontend

2015-09-18 Thread Zhou, Yuan
Hi Yehuda, I was trying to do some tests on nginx over rgw and ran into some issue on the PUT side: $ swift upload con ceph_fuse.cc Object PUT failed: http://localhost/swift/v1/con/ceph_fuse.cc 411 Length Required   MissingContentLength However the GET/HEAD/POST requests are all working. From

RE: nginx for rgw fcgi frontend

2015-09-18 Thread Zhou, Yuan
content length compat = true Thanks, -yuan -Original Message- From: Yehuda Sadeh-Weinraub [mailto:yeh...@redhat.com] Sent: Friday, September 18, 2015 11:29 PM To: Zhou, Yuan Cc: Ceph Development Subject: Re: nginx for rgw fcgi frontend On Thu, Sep 17, 2015 at 11:38 PM, Zhou, Yuan <yua

RE: testing the teuthology OpenStack backend

2015-08-21 Thread Zhou, Yuan
Hi Loic/Li, We have a local Ceph binary repo for our local teuthology testing. I'm using some modified Ceph gitbuilder (https://github.com/ceph/gitbuilder) to create the repo. The things I've changed are: 1. modify branch-local to watch our branchs only, otherwise there'll be too many

RE: quick way to rebuild deb packages

2015-07-22 Thread Zhou, Yuan
I'm also using make-debs.sh to generate the binaries for some local deployment. Note that if you need the *tests.deb you'll need to change this scripts a bit. @@ -58,8 +58,8 @@ tar -C $releasedir -zxf $releasedir/ceph_$vers.orig.tar.gz # cp -a debian $releasedir/ceph-$vers/debian cd

RE: local teuthology testing

2015-07-21 Thread Zhou, Yuan
; Zhou, Yuan Cc: David Casier AEVOO; Ceph Devel; se...@lists.ceph.com Subject: Re: local teuthology testing Hi, Since July 18th teuthology no longer uses chef, this issue has been resolved ! Using ansible requires configuration ( http://dachary.org/?p=3752 explains it shortly, maybe

local teuthology testing

2015-07-21 Thread Zhou, Yuan
Hi David/Loic, I was also trying to make some local Teuthology clusters here. The biggest issue I met is in the ceph-qa-chef - there're lots of hardcoded URL related with the sepia lab. I have to trace the code and change them line by line. Can you please kindly share me how did you get this

RGW object versioning status

2015-07-16 Thread Zhou, Yuan
Hi Yehuda, I see there's a wiki page on RGW object versioning. And from the code looks like it's already there. https://wiki.ceph.com/Development/RGW_Object_Versioning But the RGW doc tells me Swift/S3 object version is not supported. http://ceph.com/docs/master/radosgw/swift/

head object read with range get on RGW

2015-07-13 Thread Zhou, Yuan
Hi Yehuda, I trace the code and the read op seems happen at RGWRados::raw_obj_stat()? This looks like some unnecessary if the range does not fall on to the head object. I tried to set the rgw_max_chunk_size = 0 and it's not working on the PUT side. Do you have any ideas on how to avoid this

RE: CDS Jewel Wed/Thurs

2015-07-01 Thread Zhou, Yuan
Hey Patrick, Looks like the GMT+8 time for the 1st day is wrong, should be 10:00 pm - 7:30 am? -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Patrick McGarry Sent: Tuesday, June 30, 2015 11:28 PM To: Ceph Devel;

Monitor clock skew on Teuthology testing

2015-06-23 Thread Zhou, Yuan
Hi Zack, I was testing on some home-made Teuthology cluster. Till now I can use the teuthology-suite to submit the test cases and start some workers to do the tests. From the Pulpito logs I can see most of the tests are passed except there was some error when aggregating the results in the

RE: xattrs vs. omap with radosgw

2015-06-16 Thread Zhou, Yuan
FWIW, there was some discussion in OpenStack Swift and their performance tests showed 255 is not the best in recent XFS. They decided to use large xattr boundary size(65535). https://gist.github.com/smerritt/5e7e650abaa20599ff34 -Original Message- From:

RE: Regarding hadoop over RGW blueprint

2015-06-10 Thread Zhou, Yuan
Hi Somnath, The background was a bit complicated. This was part of the MOC project, which aims to setup an open-exchange cloud between several private cloud inside several universities.

RE: libcrush.so

2015-05-08 Thread Zhou, Yuan
[mailto:james@ssi.samsung.com] Sent: Saturday, May 9, 2015 1:40 AM To: Zhou, Yuan; Ceph Development Cc: Cohen, David E; Yu, Zhidong Subject: RE: libcrush.so Hi Yuan, Very interesting. Would be possible to know why application needs to access the cursh map directly instead of accessing through

libcrush.so

2015-05-07 Thread Zhou, Yuan
Ceph use crush algorithm to provide the mapping of objects to OSD servers. This is great for clients so they could talk to with these OSDs directly. However there are some scenarios where the application needs to access the crush map, for load-balancing as an example. Currently Ceph doesn't

RE: Ceph code tests / teuthology

2015-04-24 Thread Zhou, Yuan
-Original Message- From: Loic Dachary [mailto:l...@dachary.org] Sent: Monday, April 13, 2015 5:19 PM To: Zhou, Yuan Cc: Ceph Development; Zack Cerza Subject: Re: Ceph code tests / teuthology Hi, On 13/04/2015 04:39, Zhou, Yuan wrote: Hi Loic, I'm trying to setup an internal Teuthology

RE: Ceph code tests / teuthology

2015-04-24 Thread Zhou, Yuan
. Thanks for the setup doc, I'm going to have another try. Thanks, -yuan -Original Message- From: Zack Cerza [mailto:z...@redhat.com] Sent: Saturday, April 25, 2015 12:11 AM To: Sage Weil Cc: Zhou, Yuan; Loic Dachary; Ceph Development Subject: Re: Ceph code tests / teuthology If you're

Ceph code tests

2015-04-13 Thread Zhou, Yuan
Hi Loic, I'm trying to setup an internal Teuthology cluster here. I was able to setup a 3 node cluster now. however there's not much docs and I'm confused about some questions here: 1) how does Ceph upstream do tests? Currently I see there's a) Jekins(make check on each PR) b) Teuthology

Re: RGW : Transaction Id in response?

2015-02-27 Thread ZHOU Yuan
On Fri, Feb 27, 2015 at 6:31 PM, Abhishek Dixit dixita...@gmail.com wrote: On Thu, Feb 26, 2015 at 10:51 PM, Yehuda Sadeh-Weinraub yeh...@redhat.com wrote: - Original Message - From: Abhishek Dixit dixita...@gmail.com To: ceph-devel ceph-devel@vger.kernel.org Sent: Wednesday,

RE: 11/19/2014 Weekly Ceph Performance Meeting IS ON!

2014-11-24 Thread Zhou, Yuan
Hi Mark, do you have the recording videos for this meeting? Regards, -yuan -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Mark Nelson Sent: Wednesday, November 19, 2014 10:49 AM To: ceph-devel@vger.kernel.org Subject: