dosubot[bot] commented on issue #8626: URL: https://github.com/apache/incubator-devlake/issues/8626#issuecomment-3469082274
<!-- Greeting --> Hi @suchetanvg! I'm [Dosu](https://go.dosu.dev/dosubot) and Iām helping the incubator-devlake team. <!-- Answer --> Slow SonarQube pipeline stages in DevLake with large numbers of data scopes are a known challenge, especially at enterprise scale. The main bottleneck is often the single runner processing projects sequentially, which limits parallelism and causes long runtimes for each stage. Increasing container memory (at least 6GB), optimizing database indexes, and enabling shallow cloning (where applicable) have helped others speed up pipelines with large data sources. For very large scopes, reducing the scope of data collection (like limiting date ranges) or lowering page size (if configurable) can also help mitigate performance issues. Collecting backend logs during slow stages can help pinpoint bottlenecks. These strategies have been discussed in detail by other users running DevLake at scale [here](https://github.com/apache/incubator-devlake/issues/8448), [here](https://github.com/apache/incubator-devlake/issues/8596), and [here](https://github.com/apache/incubator-devlake/discussions/857 6). <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=hallucination) | [Report š](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/11232760-858c-4127-89bf-c41a88a25200?feedback_type=other)</sup> [](https://app.dosu.dev/b4e8e847-d479-4541-83a8-d88d83fea5c9/ask?utm_source=githu b) [](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/incubator-devlake/issues/8626) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
