Hi all Gluster-3.7.6 in 'Quota' problem occurs in the following test case.
(it doesn't occur if don't enable the volume quota) Volume usage mismatch occurs when using glusterfs-3.7.6 on ZFS. Can you help with the following problems? 1. zfs disk pool information root@server-1:~# zpool status pool: pool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM pool ONLINE 0 0 0 pci-0000:00:10.0-scsi-0:0:1:0 ONLINE 0 0 0 pci-0000:00:10.0-scsi-0:0:2:0 ONLINE 0 0 0 pci-0000:00:10.0-scsi-0:0:3:0 ONLINE 0 0 0 errors: No known data errors root@server-2:~# zpool status pool: pool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM pool ONLINE 0 0 0 pci-0000:00:10.0-scsi-0:0:1:0 ONLINE 0 0 0 pci-0000:00:10.0-scsi-0:0:2:0 ONLINE 0 0 0 pci-0000:00:10.0-scsi-0:0:3:0 ONLINE 0 0 0 errors: No known data errors 2. zfs volume list information root@server-1:~# zfs list NAME USED AVAIL REFER MOUNTPOINT pool 179K 11.3T 19K /pool pool/tvol1 110K 11.3T 110K /pool/tvol1 root@server-2:~# zfs list NAME USED AVAIL REFER MOUNTPOINT pool 179K 11.3T 19K /pool pool/tvol1 110K 11.3T 110K /pool/tvol1 3. gluster volume information root@server-1:~# gluster volume info Volume Name: tvol1 Type: Distribute Volume ID: 02d4c9de-e05f-4177-9e86-3b9b2195d7ab Status: Started Number of Bricks: 2 Transport-type: tcp Bricks: Brick1: 38.38.38.101:/pool/tvol1 Brick2: 38.38.38.102:/pool/tvol1 Options Reconfigured: features.quota-deem-statfs: on features.inode-quota: on features.quota: on performance.readdir-ahead: on 4. gluster volume quota list root@server-1:~# gluster volume quota tvol1 list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? ------------------------------------------------------------------------------------------------------------------------------- / 100.0GB 80%(80.0GB) 0Bytes 100.0GB No No 5. brick disk usage root@server-1:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on pool 12092178176 0 12092178176 0% /pool pool/tvol1 12092178304 128 12092178176 1% /pool/tvol1 localhost:tvol1 104857600 0 104857600 0% /run/gluster/tvol1 root@server-2:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on pool 12092178176 0 12092178176 0% /pool pool/tvol1 12092178304 128 12092178176 1% /pool/tvol1 6. client mount / disk usage root@client:~# mount -t glusterfs 38.38.38.101:/tvol1 /mnt root@client:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on 38.38.38.101:/tvol1 104857600 0 104857600 0% /mnt 7. Write using the dd command file root@client:~# dd if=/dev/urandom of=/mnt/10m bs=1048576 count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.751261 s, 14.0 MB/s 8. client disk usage root@client:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on 38.38.38.101:/tvol1 104857600 0 104857600 0% /mnt 9. brick disk usage root@server-1:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on pool 12092167936 0 12092167936 0% /pool pool/tvol1 12092178304 10368 12092167936 1% /pool/tvol1 localhost:tvol1 104857600 0 104857600 0% /run/gluster/tvol1 root@server-2:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on pool 12092178176 0 12092178176 0% /pool pool/tvol1 12092178304 128 12092178176 1% /pool/tvol1 10. zfs volume list information root@server-1:~# zfs list NAME USED AVAIL REFER MOUNTPOINT pool 10.2M 11.3T 19K /pool pool/tvol1 10.1M 11.3T 10.1M /pool/tvol1 root@server-2:~# zfs list NAME USED AVAIL REFER MOUNTPOINT pool 188K 11.3T 19K /pool pool/tvol1 110K 11.3T 110K /pool/tvol1 11. gluster volume quota list root@server-1:~# gluster volume quota tvol1 list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? ------------------------------------------------------------------------------------------------------------------------------- / 100.0GB 80%(80.0GB) 512Bytes 100.0GB No No 12. Views from the client file root@client:~# ls -al /mnt total 10246 drwxr-xr-x 4 root root 9 1월 30 02:23 . drwxr-xr-x 22 root root 4096 1월 28 07:48 .. -rw-r--r-- 1 root root 10485760 1월 30 02:23 10m drwxr-xr-x 3 root root 6 1월 30 02:14 .trashcan root@client:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on 38.38.38.101:/tvol1 104857600 10240 104847360 1% /mnt root@server-1:~# gluster volume quota tvol1 list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? ------------------------------------------------------------------------------------------------------------------------------- / 100.0GB 80%(80.0GB) 10.0MB 100.0GB No No -- Sungsik, Park/corazy [박성식, 朴成植] Software Development Engineer Email: mulg...@gmail.com ---------------------------------------------------------------------------------------- This email may be confidential and protected by legal privilege. If you are not the intended recipient, disclosure, copying, distribution and use are prohibited; please notify us immediately and delete this copy from your system. ----------------------------------------------------------------------------------------
_______________________________________________ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel