Hey, TL;DR - after another out-of-space incident, Koji is back online accepting builds.
I created new 600 GB volume and copied over the content of the /mnt/koji plus moved there directories "packages" and "external-repos" from /mnt/tmp (ephemeral volume which was filling up). Filesystem Size Used Avail Use% Mounted on /dev/xvde1 5.7G 3.0G 2.7G 53% / none 1.8G 0 1.8G 0% /dev/shm tmpfs 4.0G 44M 4.0G 2% /tmp /dev/xvdab1 591G 378G 183G 68% /mnt/koji /dev/xvdt1 50G 27G 21G 56% /mnt2/koji /dev/xvdm1 148G 108G 33G 77% /mnt2/xvdm /dev/xvdj1 367G 30G 322G 9% /mnt/tmp Old volumes xvdt1 and xvdm1 are mounted under /mnt2 and can be removed and returned to the EBS pool once we confirm koji is working again. First, I moved everything under single volume until I realized this was deadly slow. For building processes, local storage must be used. This was the reason why there was such a mess with symlinks. But due to fact that the instance was small flavor, ephemeral volume is small and limiting. Fortunately I found "packages" dirs together with "external-repos" 'moveable' to EBS volume (Koji is sensitive in multi-volume setups beacuse heavy use of hardlinks). Builds can be slower in this setup. We should have enough space now (183 G + 322 G). -- Later, Lukas #lzap Zapletal _______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list
