[sheepdog] Presentation at CloudOpen Japan 2015

2015-06-10 Thread Teruaki Ishizaki
Hi sheepdog users and developers, I had a presentaion at CloudOpenJapan 2015. The slide is here: http://events.linuxfoundation.jp/sites/events/files/slides/COJ2015_Sheepdog_20150604.pdf This slide introduce some performance results with SSD. Thanks, Teruaki -- sheepdog mailing list

[sheepdog] [PATCH] sheep: revert a part of the changes for internal res code

2015-04-26 Thread Teruaki Ishizaki
SD_RES_INODE_INVALIDATED response code is used by tgtd and, previous change broke compatibility with tgtd. It caused errors when active path was down with using iSCSI multipath. This patch reverts a part of previous commit for SD_RES_INODE_INVALIDATED. Signed-off-by: Teruaki Ishizaki tell.i

[sheepdog] [PATCH] dog: fix invalid argument for ec_decode_buffer

2015-02-22 Thread Teruaki Ishizaki
This patch change invalid argument of ec_decode_buffer() from block_size_shift to object_size. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/vdi.c |5 +++-- 1 files changed, 3 insertions(+), 2 deletions(-) diff --git a/dog/vdi.c b/dog/vdi.c index f1ebd45..15a382a

[sheepdog] [PATCH v5] sheepdog: selectable object size support

2015-02-13 Thread Teruaki Ishizaki
VDI. # qemu-img create sheepdog:test2 100M Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- V5: - Change option from block_size_shift to object_size. - Change parse type to QEMU_OPT_SIZE. - Add operation to verify max VDI size for resizing. - Change to use 4MB object size

[sheepdog] [PATCH] dog: fix to display progress bar for vdi_check correctly

2015-02-13 Thread Teruaki Ishizaki
To display progress bar for vdi_check, block_size_shift information is needed. This patch fixes to display progress bar correctly. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/vdi.c |1 + 1 files changed, 1 insertions(+), 0 deletions(-) diff --git a/dog/vdi.c b/dog

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-12 Thread Teruaki Ishizaki
at 06:56:33PM +0900, Teruaki Ishizaki wrote: (2015/02/10 17:58), Liu Yuan wrote: On Tue, Feb 10, 2015 at 05:22:02PM +0900, Teruaki Ishizaki wrote: (2015/02/10 12:10), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-12 Thread Teruaki Ishizaki
(2015/02/12 11:55), Liu Yuan wrote: On Thu, Feb 12, 2015 at 11:33:16AM +0900, Teruaki Ishizaki wrote: (2015/02/12 11:19), Liu Yuan wrote: On Thu, Feb 12, 2015 at 10:51:25AM +0900, Teruaki Ishizaki wrote: (2015/02/10 20:12), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-12 Thread Teruaki Ishizaki
(2015/02/13 11:01), Liu Yuan wrote: On Fri, Feb 13, 2015 at 10:33:04AM +0900, Teruaki Ishizaki wrote: (2015/02/12 11:55), Liu Yuan wrote: On Thu, Feb 12, 2015 at 11:33:16AM +0900, Teruaki Ishizaki wrote: (2015/02/12 11:19), Liu Yuan wrote: On Thu, Feb 12, 2015 at 10:51:25AM +0900, Teruaki

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-11 Thread Teruaki Ishizaki
(2015/02/10 20:12), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch enables users to handle block_size_shift value for calculating VDI object size. When you start qemu, you

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-11 Thread Teruaki Ishizaki
(2015/02/12 11:19), Liu Yuan wrote: On Thu, Feb 12, 2015 at 10:51:25AM +0900, Teruaki Ishizaki wrote: (2015/02/10 20:12), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch

[sheepdog] [PATCH] dog: fix to calculate a resizable max VDI size appropriately

2015-02-10 Thread Teruaki Ishizaki
A resizable max VDI size was fixed value, 4TB. So, when block_size_shift was specified more than 22, resizing VDI size over 4TB caused error. This patch enables to calculate a resizable max VDI properly. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/vdi.c | 24

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-10 Thread Teruaki Ishizaki
(2015/02/10 17:58), Liu Yuan wrote: On Tue, Feb 10, 2015 at 05:22:02PM +0900, Teruaki Ishizaki wrote: (2015/02/10 12:10), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch

Re: [sheepdog] [PATCH] dog: fix to calculate a resizable max VDI size appropriately

2015-02-10 Thread Teruaki Ishizaki
(2015/02/10 18:01), Liu Yuan wrote: On Tue, Feb 10, 2015 at 05:53:44PM +0900, Teruaki Ishizaki wrote: A resizable max VDI size was fixed value, 4TB. Why we max VDI size is 4TB if we have object size more than 4MB? I remember in the past max size is 4TB because object is 4MB. Sorry

[sheepdog] [PATCH] dog: fix vdi_alter_copy for using a right block_size_shift

2015-02-09 Thread Teruaki Ishizaki
Previously dog vdi_alter_copy command was failed, because of using a invalid block_size_shift. This patch fix to use a right block_size_shift. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/vdi.c |1 + 1 files changed, 1 insertions(+), 0 deletions(-) diff --git a/dog

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-05 Thread Teruaki Ishizaki
(2015/02/06 11:18), Liu Yuan wrote: On Wed, Feb 04, 2015 at 01:54:19PM +0900, Teruaki Ishizaki wrote: (2015/02/02 15:52), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch

Re: [sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-02-03 Thread Teruaki Ishizaki
(2015/02/02 15:52), Liu Yuan wrote: On Tue, Jan 27, 2015 at 05:35:27PM +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch enables users to handle block_size_shift value for calculating VDI object size. When you start qemu, you

[sheepdog] [PATCH] sheep: fix to handle the variable type of data_length

2015-01-27 Thread Teruaki Ishizaki
Previously, data_length was handled as integer in some places. But, data_length of a request/response data type is uint32_t, so there were some bad behaviors. This patch fixes to handle data_length as uint32_t. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- include/net.h

[sheepdog] [PATCH v4] sheepdog: selectable object size support

2015-01-27 Thread Teruaki Ishizaki
, a default value of sheepdog cluster is used for creating VDI. # qemu-img create sheepdog:test2 100M Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- V4: - Limit a read/write buffer size for creating a preallocated VDI. - Replace a parse function for the block_size_shift option

Re: [sheepdog] [PATCH v3] sheepdog: selectable object size support

2015-01-26 Thread Teruaki Ishizaki
(2015/01/26 19:33), Kevin Wolf wrote: Am 26.01.2015 um 10:52 hat Teruaki Ishizaki geschrieben: Hi, Kevin Thanks for your review! (2015/01/23 22:53), Kevin Wolf wrote: Am 23.01.2015 um 09:24 hat Teruaki Ishizaki geschrieben: Previously, qemu block driver of sheepdog used hard-coded VDI

Re: [sheepdog] [PATCH v3] sheepdog: selectable object size support

2015-01-26 Thread Teruaki Ishizaki
Hi, Kevin Thanks for your review! (2015/01/23 22:53), Kevin Wolf wrote: Am 23.01.2015 um 09:24 hat Teruaki Ishizaki geschrieben: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch enables users to handle block_size_shift value for calculating VDI object size

[sheepdog] [PATCH v3] sheepdog: selectable object size support

2015-01-23 Thread Teruaki Ishizaki
, a default value of sheepdog cluster is used for creating VDI. # qemu-img create sheepdog:test2 100M Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- V3: - Delete the needless operation of buffer. - Delete the needless operations of request header for SD_OP_GET_CLUSTER_DEFAULT

Re: [sheepdog] [PATCH v2] sheepdog: selectable object size support

2015-01-22 Thread Teruaki Ishizaki
Hi, Hitoshi Thanks for your review! (2015/01/22 14:22), Hitoshi Mitake wrote: At Tue, 20 Jan 2015 16:14:28 +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch enables users to handle block_size_shift value for calculating VDI

[sheepdog] [PATCH] dog: fix not to use both options -y and -z simultaneously

2015-01-22 Thread Teruaki Ishizaki
Now, selectable block_size_shift feature don't support to use HyperVolume simultaneously. But, users can create a new VDI with both options, -y and -z, with dog command. This patch changes that users can't specify both those options to create a new VDI. Signed-off-by: Teruaki Ishizaki

[sheepdog] [PATCH v2] sheepdog: selectable object size support

2015-01-19 Thread Teruaki Ishizaki
, a default value of sheepdog cluster is used for creating VDI. # qemu-img create sheepdog:test2 100M Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- V2: - Fix coding style problem (white space). - Add members, store_policy and block_size_shift to struct SheepdogVdiReq

Re: [sheepdog] [PATCH] sheepdog: selectable object size support

2015-01-16 Thread Teruaki Ishizaki
Hi Hitoshi, Thanks for your check. (2015/01/15 15:05), Hitoshi Mitake wrote: At Tue, 13 Jan 2015 17:41:12 +0900, Teruaki Ishizaki wrote: Previously, qemu block driver of sheepdog used hard-coded VDI object size. This patch enables users to handle block_size_shift value for calculating VDI

[sheepdog] [PATCH] sheep: add operation to get cluster default setting

2015-01-09 Thread Teruaki Ishizaki
Qemu backend driver for sheepdog used a hard-coded value 'SD_DATA_OBJ_SIZE' when you created VDI with qemu-img command. Then, this patch add operation SD_OP_GET_CLUSTER_DEFAULT to get a cluster default value of block_size_shift for creating a VDI. Signed-off-by: Teruaki Ishizaki ishizaki.teru

[sheepdog] [PATCH] func/test: change functional test output for __vdi_list

2014-12-16 Thread Teruaki Ishizaki
Change output of functional test using __vdi_list in assosiation with adding block_size_shift information to vdi list command. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- tests/functional/016.out |2 +- tests/functional/029.out | 18 +++--- tests/functional/030.out

[sheepdog] [PATCH] sheep: fix bug for not saving block_size_shift to cluster config

2014-12-16 Thread Teruaki Ishizaki
This patch fixes bugs that block_size_shift info was forgotten after cluster shutdown and start sheepdog. Add block_size_shift info to cluster config file. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- sheep/config.c |6 -- 1 files changed, 4 insertions(+), 2

Re: [sheepdog] [PATCH] sheep, dog: check cluster is formatted or not during vdi creation

2014-12-16 Thread Teruaki Ishizaki
'-z' to create larger object size volume This patch revives previous behavior. Cc: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp Signed-off-by: Hitoshi Mitake mitake.hito...@lab.ntt.co.jp --- dog/vdi.c | 7 +++ sheep/ops.c | 3 +++ 2 files changed, 10 insertions(+) I've

[sheepdog] [PATCH v2 1/3] Add block_size_shift member to sheepdog internal data.

2014-12-12 Thread Teruaki Ishizaki
This patch adds a information of block_size_shift to sheepdog request, response, state. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- include/internal_proto.h |5 - include/sheepdog_proto.h |8 ++-- 2 files changed, 10 insertions(+), 3 deletions(-) diff

[sheepdog] [PATCH v2 0/3] selectable data object size of a VDI

2014-12-12 Thread Teruaki Ishizaki
Previously users could use 4MB data object size for a VDI This patchset enables users to specify data object size of a VDI and make a larger VDI without Hypervolume. Teruaki Ishizaki (3): Add block_size_shift member to sheepdog internal data. dog: add block_size_shift option to cluster format

[sheepdog] [PATCH v2 3/3] Add selectable object_size support of VDI operation

2014-12-12 Thread Teruaki Ishizaki
Data object size was fix to 4MB and not selectable. This patch add feature to select data object size of VDI. If you want to use 8MB(2^23) data object_size, specify the block_size_shift bit num to 23. ex) dog vdi create -z 23 testvdi 100M Signed-off-by: Teruaki Ishizaki ishizaki.teru

[sheepdog] [PATCH v2 2/3] dog: add block_size_shift option to cluster format command

2014-12-12 Thread Teruaki Ishizaki
This patch changes for specifying cluster default block_size_shift. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/cluster.c| 37 +++-- dog/farm/farm.c |5 - dog/farm/farm.h | 12 dog

Re: [sheepdog] [PATCH 3/3] add selectable object_size support of VDI operation (1/2)

2014-12-11 Thread Teruaki Ishizaki
@@ -451,10 +462,34 @@ static int vdi_create(int argc, char **argv) if (ret 0) return EXIT_USAGE; - if (size SD_OLD_MAX_VDI_SIZE 0 == vdi_cmd_data.store_policy) { + if (vdi_cmd_data.object_size) + old_max_total_size = +

[sheepdog] [PATCH 2/3] dog: add object_size_shift option to cluster format command

2014-12-09 Thread Teruaki Ishizaki
This patch changes for specifying cluster default object_size. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/cluster.c | 37 +++-- dog/farm/farm.c|5 - dog/farm/farm.h|8 ++-- dog/farm

[sheepdog] [PATCH 3/3] add selectable object_size support of VDI operation

2014-12-09 Thread Teruaki Ishizaki
Data object size was fix to 4MB and not selectable. This patch add feature to select data object size of VDI. If you want to use 8MB data object_size, specify the shift bit num. ex) dog vdi create -z 23 hogehoge 100M Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog

[sheepdog] [PATCH 0/3] selectable data object size of a VDI

2014-12-09 Thread Teruaki Ishizaki
Previously users could use 4MB data object size for a VDI This patchset enables users to specify data object size of a VDI and make a larger VDI without Hypervolume. Teruaki Ishizaki (3): Add object_size member to sheepdog internal data. dog: add object_size_shift option to cluster format

[sheepdog] [PATCH 1/3] Add object_size member to sheepdog internal data.

2014-12-09 Thread Teruaki Ishizaki
This patch adds a information of data object size to sheepdog request, response, state. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- include/internal_proto.h |3 ++- include/sheepdog_proto.h |6 ++ 2 files changed, 8 insertions(+), 1 deletions(-) diff --git

[sheepdog] [PATCH] dog: fix segfault bug of getting snapshot for LOCK_STATE_SHARED VDI.

2014-12-03 Thread Teruaki Ishizaki
After iSCSI initiator logins to the iSCSI target of the VDI, getting snapshot for that volume causes segault. This patch fixes false loop. Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- dog/vdi.c |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/dog

Re: [sheepdog] [PATCH v2] sheep: add an option for selecting the output directory of sheep.log

2013-12-11 Thread Teruaki Ishizaki
2013/12/11 Liu Yuan namei.u...@gmail.com: On Wed, Dec 11, 2013 at 04:25:45PM +0900, Teruaki Ishizaki wrote: Previously sheep.log was saved in the Sheepdog store directory, and used size of Sheepdog store directory included log file size. So, administrator couldn't do capacity planning simply

Re: [sheepdog] [PATCH] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Teruaki Ishizaki
2013/12/11 Liu Yuan namei.u...@gmail.com: On Wed, Dec 11, 2013 at 10:31:54AM +0900, Ryusuke Konishi wrote: On Wed, 11 Dec 2013 10:22:05 +0900, Hitoshi Mitake wrote: At Tue, 10 Dec 2013 12:36:06 +0800, Liu Yuan wrote: On Mon, Dec 09, 2013 at 08:49:45PM +0900, Teruaki Ishizaki wrote

[sheepdog] [PATCH v2] sheep: add an option for selecting the output directory of sheep.log

2013-12-10 Thread Teruaki Ishizaki
=log_output_dir Example: $ sheep -L dir=/logdir /datastore Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- sheep/sheep.c | 36 ++-- 1 files changed, 34 insertions(+), 2 deletions(-) diff --git a/sheep/sheep.c b/sheep/sheep.c index 9d9afa0

[sheepdog] [PATCH] sheep: merge options related to sheep.log

2013-12-10 Thread Teruaki Ishizaki
Previously, sheep had many log options, -l, -F , -d and -L. This patch merge options to the option '-l'. Usage: $ sheep -l dir=log_directory,level=log_level_num,format=log_format Example: $ sheep -l dir=/logdir,level=7,format=server Signed-off-by: Teruaki Ishizaki ishizaki.teru

[sheepdog] [PATCH] sheep: add an option for selecting the output directory of sheep.log

2013-12-09 Thread Teruaki Ishizaki
=log_output_dir Example: $ sheep -L dir=/logdir /datastore Signed-off-by: Teruaki Ishizaki ishizaki.teru...@lab.ntt.co.jp --- sheep/sheep.c | 36 ++-- 1 files changed, 34 insertions(+), 2 deletions(-) diff --git a/sheep/sheep.c b/sheep/sheep.c index 9d9afa0