[
https://issues.apache.org/jira/browse/RATIS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561647#comment-17561647
]
Lijie Wen commented on RATIS-1606:
----------------------------------
Dear Tsz-wo Sze, thanks for your help. I will show several testing and the
outputs in the following.
Testing 1: bufferSize=1048576, size=1048576, numFiles=100
Command for client:
BIN=ratis-examples/src/main/bin
PEERS=n0:127.0.0.1:6000,n1:127.0.0.1:6001,n2:127.0.0.1:6002
${BIN}/client.sh filestore loadgen --size 1048576 --numFiles 100 --storage
/tmp/ratis/loadgen --numClients 6 --peers ${PEERS} --bufferSize 1048576
Output 1 of Raft Log:
192:ratis-master lijiewen$ ls -Gl
/tmp/ratis/n0/64656d6f-5261-6674-4772-6f7570313233/current
total 8304
-rw-r--r-- 1 lijiewen wheel 827 7 2 08:24 log_0-8
-rw-r--r-- 1 lijiewen wheel 765 7 2 08:24 log_18-26
-rw-r--r-- 1 lijiewen wheel 751 7 2 08:24 log_27-34
-rw-r--r-- 1 lijiewen wheel 750 7 2 08:24 log_35-42
-rw-r--r-- 1 lijiewen wheel 764 7 2 08:24 log_43-51
-rw-r--r-- 1 lijiewen wheel 765 7 2 08:24 log_52-60
-rw-r--r-- 1 lijiewen wheel 765 7 2 08:24 log_61-69
-rw-r--r-- 1 lijiewen wheel 751 7 2 08:24 log_70-77
-rw-r--r-- 1 lijiewen wheel 777 7 2 08:24 log_78-87
-rw-r--r-- 1 lijiewen wheel 752 7 2 08:24 log_88-95
-rw-r--r-- 1 lijiewen wheel 762 7 2 08:24 log_9-17
-rw-r--r-- 1 lijiewen wheel 765 7 2 08:24 log_96-104
-rw-r--r-- 1 lijiewen wheel 4194304 7 2 08:24 log_inprogress_105
-rw-r--r-- 1 lijiewen wheel 51 7 2 08:23 raft-meta
-rw-r--r-- 1 lijiewen wheel 70 7 2 08:23 raft-meta.conf
Testing 2: bufferSize=1024, size=1048576, numFiles=100
Command for client:
BIN=ratis-examples/src/main/bin
PEERS=n0:127.0.0.1:6000,n1:127.0.0.1:6001,n2:127.0.0.1:6002
${BIN}/client.sh filestore loadgen --size 1048576 --numFiles 100 --storage
/tmp/ratis/loadgen --numClients 6 --peers ${PEERS} --bufferSize 1024
Output 2 of Raft Log:
192:ratis-master lijiewen$ ls -Gl
/tmp/ratis/n0/64656d6f-5261-6674-4772-6f7570313233/current
total 26704
-rw-r--r-- 1 lijiewen wheel 712371 7 2 08:32 log_0-7812
-rw-r--r-- 1 lijiewen wheel 728791 7 2 08:32 log_15729-23665
-rw-r--r-- 1 lijiewen wheel 729627 7 2 08:32 log_23666-31531
-rw-r--r-- 1 lijiewen wheel 729564 7 2 08:32 log_31532-39393
-rw-r--r-- 1 lijiewen wheel 728252 7 2 08:32 log_39394-47173
-rw-r--r-- 1 lijiewen wheel 729097 7 2 08:32 log_47174-55003
-rw-r--r-- 1 lijiewen wheel 728791 7 2 08:32 log_55004-62815
-rw-r--r-- 1 lijiewen wheel 728213 7 2 08:32 log_62816-70593
-rw-r--r-- 1 lijiewen wheel 730055 7 2 08:32 log_70594-78484
-rw-r--r-- 1 lijiewen wheel 715764 7 2 08:32 log_7813-15728
-rw-r--r-- 1 lijiewen wheel 729292 7 2 08:32 log_78485-86330
-rw-r--r-- 1 lijiewen wheel 728575 7 2 08:32 log_86331-94129
-rw-r--r-- 1 lijiewen wheel 728113 7 2 08:32 log_94130-101895
-rw-r--r-- 1 lijiewen wheel 4194304 7 2 08:32 log_inprogress_101896
-rw-r--r-- 1 lijiewen wheel 51 7 2 08:32 raft-meta
-rw-r--r-- 1 lijiewen wheel 70 7 2 08:32 raft-meta.conf
You can see that when bufferSize=1048576, the size of each raft log is about
750 bytes, while for bufferSize=1024, the value is about 720K. But as I can
imagine, the size of each raft log should be 8M.
> The parameter bufferSize in the filestore example affects the sizes of Raft
> logs
> --------------------------------------------------------------------------------
>
> Key: RATIS-1606
> URL: https://issues.apache.org/jira/browse/RATIS-1606
> Project: Ratis
> Issue Type: Bug
> Components: examples
> Affects Versions: 2.3.0
> Reporter: Lijie Wen
> Priority: Minor
>
> Dear all,
> I downloaded the latest version of ratis and run the filestore example using
> the default parameters for the three servers. I tried different bufferSize
> parameter values for the client. As bufferSize increases from 1024 to
> 1024*1024, the file size of each closed segmented raft log becomes smaller
> and smaller. In my thought, the file size of each closed segmented raft log
> should be equal to 8M, am I right? Why does this phenomenon happen?
>
> The run command for the client is like the following:
> BIN=ratis-examples/src/main/bin
> PEERS=n0:127.0.0.1:6000,n1:127.0.0.1:6001,n2:127.0.0.1:6002
> ${BIN}/client.sh filestore loadgen --size 2097152 --numFiles 500 --storage
> /tmp/ratis/loadgen --numClients 6 --peers ${PEERS} --bufferSize 1024
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
