Re: [sheepdog] [PATCH v2] sheep: make config file compatible with the previous one

2012-08-21 Thread Liu Yuan
On 08/21/2012 02:37 AM, MORITA Kazutaka wrote: Signed-off-by: MORITA Kazutaka morita.kazut...@lab.ntt.co.jp --- Changes from v1: - remove 'version' from sheepdog_config Even if we don't support a version check of the config in the next release, we should fix the compatibility issue at

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 1:50 PM, Dietmar Maurer diet...@proxmox.com wrote: Disabling automatic recovery by default doesn't work for you? You can control the time to start recovery with collie cluster recover enable. It just looks strange to me to design the system for immediate/automatic

Re: [sheepdog] [PATCH 1/2] collie: optimize 'collie vdi check' command

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 1:48 PM, Yunkai Zhang yunkai...@gmail.com wrote: On Tue, Aug 21, 2012 at 1:42 PM, MORITA Kazutaka morita.kazut...@lab.ntt.co.jp wrote: At Thu, 16 Aug 2012 22:38:21 +0800, Yunkai Zhang wrote: After add '-F' flag, the help looks like: $ collie vdi check Usage: collie

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Bastian Scholz
Hi Dietmar, Hi Yuan, Am 2012-08-21 07:27, schrieb Dietmar Maurer: Membership change can happen for many reason. It can happen if something is wrong on the switch (or if some admin configures the switch), a damaged network cable, a bug in the bonding driver, a damaged network card, or simply a

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread MORITA Kazutaka
At Tue, 21 Aug 2012 14:14:23 +0800, Yunkai Zhang wrote: I need a conclusion: Does sheepdog need delay recovery supported by this series (or by Kazum's new idea and implementation) ? There are two different discussion in this thread: 1. turn on/off automatic recovery with a collie command

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 2:43 PM, MORITA Kazutaka morita.kazut...@lab.ntt.co.jp wrote: At Tue, 21 Aug 2012 14:14:23 +0800, Yunkai Zhang wrote: I need a conclusion: Does sheepdog need delay recovery supported by this series (or by Kazum's new idea and implementation) ? There are two

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Liu Yuan
On 08/21/2012 02:48 PM, Yunkai Zhang wrote: Ok, I'll continue to improve this series after I complete other things. Why not choose Kazutaka's idea to implement delay recovery? It looks simple yet efficient at least to me. Thanks, Yuan -- sheepdog mailing list sheepdog@lists.wpkg.org

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 2:58 PM, Liu Yuan namei.u...@gmail.com wrote: On 08/21/2012 02:48 PM, Yunkai Zhang wrote: Ok, I'll continue to improve this series after I complete other things. Why not choose Kazutaka's idea to implement delay recovery? It looks simple yet efficient at least to me.

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 3:04 PM, Yunkai Zhang yunkai...@gmail.com wrote: On Tue, Aug 21, 2012 at 2:58 PM, Liu Yuan namei.u...@gmail.com wrote: On 08/21/2012 02:48 PM, Yunkai Zhang wrote: Ok, I'll continue to improve this series after I complete other things. Why not choose Kazutaka's idea to

Re: [sheepdog] [PATCH 1/2] collie: optimize 'collie vdi check' command

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 2:26 PM, Yunkai Zhang yunkai...@gmail.com wrote: On Tue, Aug 21, 2012 at 1:48 PM, Yunkai Zhang yunkai...@gmail.com wrote: On Tue, Aug 21, 2012 at 1:42 PM, MORITA Kazutaka morita.kazut...@lab.ntt.co.jp wrote: At Thu, 16 Aug 2012 22:38:21 +0800, Yunkai Zhang wrote:

[sheepdog] [PATCH V2 1/4] collie: add private options to collie's command

2012-08-21 Thread Yunkai Zhang
From: Yunkai Zhang qiushu@taobao.com V2: - update commit log, make it more descriptive - use 'options' name in inner struct instread of 'self_options' --- 8 Now, all collie's command share the same global collie_options, it will

[sheepdog] [PATCH V2 2/4] collie: optimize 'collie vdi check' command

2012-08-21 Thread Yunkai Zhang
From: Yunkai Zhang qiushu@taobao.com V2: - use '-R, --repair' instread of '-F, --force_repair' - not connect to target sheep directly - define a member name instead of using __pad. - update this commit log -- 8 Reading all of vdi's objects from

[sheepdog] [PATCH V2 3/4] man: update 'collie vdi check' doc

2012-08-21 Thread Yunkai Zhang
From: Yunkai Zhang qiushu@taobao.com Signed-off-by: Yunkai Zhang qiushu@taobao.com --- man/collie.8 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/man/collie.8 b/man/collie.8 index 359c409..d42c3d5 100644 --- a/man/collie.8 +++ b/man/collie.8 @@ -67,7 +67,7 @@ This

[sheepdog] [PATCH] test: add test for recovery logic

2012-08-21 Thread Liu Yuan
From: Liu Yuan tailai...@taobao.com Signed-off-by: Liu Yuan tailai...@taobao.com --- tests/027 | 33 + tests/027.out |5 + tests/common.rc | 10 ++ tests/group |1 + 4 files changed, 49 insertions(+), 0 deletions(-) create

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Tue, Aug 21, 2012 at 2:03 AM, MORITA Kazutaka morita.kazut...@lab.ntt.co.jp wrote: At Mon, 20 Aug 2012 23:34:10 +0800, Yunkai Zhang wrote: In fact, I have thought this method, but we should face nearly the same problem: After sheep joined back, it should known which objects is dirty,

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread MORITA Kazutaka
At Wed, 22 Aug 2012 01:16:49 +0800, Yunkai Zhang wrote: I have read and do simple test with this patch, it works at most time. But write operation will be blocked in wait_forward_request(), I think there are some corner case we should handle. Can you create a testcase to reproduce it?

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Wed, Aug 22, 2012 at 9:31 AM, MORITA Kazutaka morita.kazut...@lab.ntt.co.jp wrote: At Wed, 22 Aug 2012 01:16:49 +0800, Yunkai Zhang wrote: I have read and do simple test with this patch, it works at most time. But write operation will be blocked in wait_forward_request(), I think there

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Liu Yuan
On 08/22/2012 09:44 AM, Yunkai Zhang wrote: ould you give a mature patch? We really want to use it in our cluster as soon as possible. Okay, but I'm currently working on another problem - sheep blocks I/O requests long time while stale objects are moved to the farm backend store. I'll

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Wed, Aug 22, 2012 at 9:55 AM, Liu Yuan namei.u...@gmail.com wrote: On 08/22/2012 09:44 AM, Yunkai Zhang wrote: ould you give a mature patch? We really want to use it in our cluster as soon as possible. Okay, but I'm currently working on another problem - sheep blocks I/O requests long

Re: [sheepdog] [PATCH V2 00/11] INTRODUCE

2012-08-21 Thread Yunkai Zhang
On Wed, Aug 22, 2012 at 10:21 AM, MORITA Kazutaka morita.kazut...@lab.ntt.co.jp wrote: At Wed, 22 Aug 2012 10:14:07 +0800, Yunkai Zhang wrote: My intention is to respect Kazum's idea, if need my help, I'm pleasure to do it:). If you complete the work, it will help me a lot. :) Well, I'll

[sheepdog] Sheepdog 0.5.0 schedule and todos

2012-08-21 Thread MORITA Kazutaka
Hi all, I think of releasing 0.5.0 on the early September. TODO items for the release are: - different redundancy level for each VDI - 'collie cluster recover' to enable/disable automatic recovery - 'collie vdi backup/restore' to get a differential backup between snapshots - another

[sheepdog] [PATCH] tests: kill sheep with signal KILL

2012-08-21 Thread levin li
From: levin li xingke@taobao.com In some case, we use pkill -f to kill a sheep node, and the log process isn't killed immediately and becomes a defunt process which take problems for the next start of the same node. Signed-off-by: levin li xingke@taobao.com --- tests/common.rc |2 +-