Re: [PATCH v3 2/2] erofs-utils: optimize mkfs to O(N), N = #files

2021-01-15 Thread Gao Xiang
Hi Weiwen, On Sat, Jan 16, 2021 at 01:04:38PM +0800, Gao Xiang via Linux-erofs wrote: > From: Hu Weiwen > > When using EROFS to pack our dataset which consists of millions of > files, mkfs.erofs is very slow compared with mksquashfs. > > The bottleneck is `erofs_balloc` and `erofs_mapbh` functi

[PATCH v3 2/2] erofs-utils: optimize mkfs to O(N), N = #files

2021-01-15 Thread Gao Xiang via Linux-erofs
From: Hu Weiwen When using EROFS to pack our dataset which consists of millions of files, mkfs.erofs is very slow compared with mksquashfs. The bottleneck is `erofs_balloc` and `erofs_mapbh` function, which iterate over all previously allocated buffer blocks, making the complexity of the algrith