Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread Ulrich Sibiller
On 6/2/21 4:12 PM, IBM Spectrum Scale wrote: The data and metadata replications are 2 on both source and destination filesystems, so from: $ mmrepquota -j srcfilesys | grep fileset srcfileset FILESET         800        800        800          0     none |       863       0        0        0  

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread Hannappel, Juergen
uss-boun...@spectrumscale.org, gpfsug-disc...@gpfsug.org > Sent: Wednesday, 2 June, 2021 16:12:52 > Subject: Re: [gpfsug-discuss] du --apparent-size and quota > Hi, > The data and metadata replications are 2 on both source and destination > filesystems, so from: > $ mmrepquota -j

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread IBM Spectrum Scale
Re: [gpfsug-discuss] du --apparent-size and quota Sent by:gpfsug-discuss-boun...@spectrumscale.org On 6/1/21 6:08 PM, Kumaran Rajaram wrote: >>> If I'm not mistaken even with SS5 created filesystems, 1 MiB FS block size implies 32 kiB sub blocks (32 sub-blocks). > >

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread Dugan, Michael J
AM To: gpfsug-discuss@spectrumscale.org Subject: Re: [gpfsug-discuss] du --apparent-size and quota On 6/2/21 1:09 PM, Jonathan Buzzard wrote: >> My rsync is using -AHS, so this should not be relevant here. > > I wonder have you done more than one rsync? If so are you us

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread Ulrich Sibiller
On 6/2/21 1:09 PM, Jonathan Buzzard wrote: My rsync is using -AHS, so this should not be relevant here. I wonder have you done more than one rsync? If so are you using --delete? If not and the source fileset has changed then you will be accumulating files at the destination and it would

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread Jonathan Buzzard
On 02/06/2021 11:16, Ulrich Sibiller wrote: [SNIP] My rsync is using -AHS, so this should not be relevant here. I wonder have you done more than one rsync? If so are you using --delete? If not and the source fileset has changed then you will be accumulating files at the destination and

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-02 Thread Ulrich Sibiller
On 6/1/21 6:08 PM, Kumaran Rajaram wrote: If I'm not mistaken even with SS5 created filesystems, 1 MiB FS block size implies 32 kiB sub blocks (32 sub-blocks). Just to add: The /srcfilesys seemed to have been created with GPFS version 4.x which supports only 32 sub-blocks per block. -T

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-01 Thread Kumaran Rajaram
rumscale.org On Behalf Of Loic Tortay Sent: Tuesday, June 1, 2021 10:57 AM To: gpfsug main discussion list ; Ulrich Sibiller ; gpfsug-disc...@gpfsug.org Subject: Re: [gpfsug-discuss] du --apparent-size and quota On 6/1/21 4:26 PM, Ulrich Sibiller wrote: [...] > ) > > While trying to un

Re: [gpfsug-discuss] du --apparent-size and quota

2021-06-01 Thread Loic Tortay
On 6/1/21 4:26 PM, Ulrich Sibiller wrote: [...] > ) > > While trying to understand what's going on here I found this on the > source file system (which is valid for all files, with different number > of course): > > $ du --block-size 1 /srcfilesys/fileset/filename > 65536  

[gpfsug-discuss] du --apparent-size and quota

2021-06-01 Thread Ulrich Sibiller
Hi, I experience some strangeness that I fail to understand completely. I have a fileset that got copied (rsynced) from one cluster to another. The reported size (mmrepquota) of the source filesystem is 800G (and due to data and metadata replication being set to 2 this effectively means 400G).