Combining the two patches resulted in a further 25% reduction of do_index_load() but with index load times getting smaller, that only resulted in a 3% improvement in total git command time. Given the greater complexity of this patch, we've decided to put it on hold for now. We'll keep it in our back pocket in case we need it in the future.
Further testing has revealed that switching from the regular heap to a
refactored version of the mem_pool in fast-import.c produces similar
gains as parallelizing do_index_load(). This appears to be a much
simpler patch for similar gains so we will be pursuing that path.
- [PATCH v1 1/4] fastindex: speed up index load through paral... Ben Peart
- Re: [PATCH v1 1/4] fastindex: speed up index load thro... Junio C Hamano
- Re: [PATCH v1 1/4] fastindex: speed up index load ... Ben Peart
- Re: [PATCH v1 1/4] fastindex: speed up index l... Junio C Hamano
- Re: [PATCH v1 1/4] fastindex: speed up ind... Ben Peart
- Re: [PATCH v1 1/4] fastindex: speed u... Junio C Hamano
- Re: [PATCH v1 1/4] fastindex: spe... Ben Peart
- Re: [PATCH v1 1/4] fastindex: spe... Junio C Hamano
- Re: [PATCH v1 1/4] fastindex: spe... Ben Peart
- Re: [PATCH v1 1/4] fastindex: spe... Junio C Hamano
- Re: [PATCH v1 1/4] fastindex: spe... Ben Peart
- Re: [PATCH v1 1/4] fastindex: spe... Jeff King
- Re: [PATCH v1 1/4] fastindex: spe... Jeff King
- Re: [PATCH v1 1/4] fastindex: spe... Ramsay Jones
- Re: [PATCH v1 1/4] fastindex: spe... Ben Peart
- [PATCH v1 4/4] fastindex: add documentation for the fastind... Ben Peart

