GitHub user dosubot[bot] added a comment to the discussion: Pipeline running for days
<!-- Answer --> For the Jira error, Atlassian removed the V2 API endpoint, so DevLake needs to use `/rest/api/3/search/jql` instead. This was fixed in PR #8559—upgrading to a version that includes this change (like v1.0.3-beta5) should resolve the issue for Jira integration [[source](https://github.com/apache/incubator-devlake/issues/8563)]. On the pipeline hanging with your largest GitHub repo: even without explicit resource constraints, large data collections can silently stall if memory is insufficient. Users have resolved similar issues by increasing container memory to at least 6GB [[source](https://github.com/apache/incubator-devlake/issues/8480)]. If the pipeline still progresses slowly, check for plugin-specific bugs: in recent versions, the GitHub GraphQL plugin sometimes mismatches data formats between "Collect Job Runs" and "Extract Jobs," causing incomplete extraction or stalls [[source](https://github.com/apache/incubator-devlake/issues/8383)]. If you upgraded recently, a full data recollection may help. For large repos, you can also try enabling shallow cloning, setting `SkipCommitStat` and `SkipCommitFiles` to true, and ensuring `NoShallowClone` is false to reduce memory usage [[source](https://github.com/apache/incubator-devlake/issues/8277)]. Batch processing and double cloning methods are available if you need further optimization. If the pipeline continues to hang or crawl, sharing more logs or your pipeline config could help pinpoint the bottleneck. <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/8ce892a1-2e58-479a-85a1-74ca0d6cdc4e?feedback_type=other)</sup> [](https://app.dosu.dev/b4e8e847-d479-4541-83a8-d88d83fea5c9/ask?utm_source=github)& nbsp;[](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/incubator-devlake/discussions/8576) GitHub link: https://github.com/apache/incubator-devlake/discussions/8576#discussioncomment-14401772 ---- This is an automatically sent email for dev@devlake.apache.org. To unsubscribe, please send an email to: dev-unsubscr...@devlake.apache.org
