Mandla-SM opened a new issue, #8277: URL: https://github.com/apache/incubator-devlake/issues/8277
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues. ### What happened "Collect data in full refresh", for bitbucket server in beta4 and beta5 throw the following error: attached stack trace -- stack trace: | github.com/apache/incubator-devlake/server/services.runPipeline | /app/server/services/pipeline_runner.go:79 | [...repeated from below...] Wraps: (2) Error running pipeline 39. Wraps: (3) attached stack trace -- stack trace: | github.com/apache/incubator-devlake/server/services.RunTasksStandalone | /app/server/services/task.go:217 | github.com/apache/incubator-devlake/server/services.(*pipelineRunner).runPipelineStandalone.func1 | /app/server/services/pipeline_runner.go:42 | github.com/apache/incubator-devlake/core/runner.runPipelineTasks | /app/core/runner/run_pipeline.go:90 | github.com/apache/incubator-devlake/core/runner.RunPipeline | /app/core/runner/run_pipeline.go:54 | github.com/apache/incubator-devlake/server/services.(*pipelineRunner).runPipelineStandalone | /app/server/services/pipeline_runner.go:38 | github.com/apache/incubator-devlake/server/services.runPipeline | /app/server/services/pipeline_runner.go:76 | github.com/apache/inc ubator-devlake/server/services.RunPipelineInQueue.func1 | /app/server/services/pipeline.go:349 | runtime.goexit | /usr/local/go/src/runtime/asm_amd64.s:1598 Wraps: (4) attached stack trace | -- stack trace: | | github.com/apache/incubator-devlake/server/services.RunTasksStandalone.func1 | | /app/server/services/task.go:189 | Wraps: (2) Error running task 4877. | Wraps: (3) attached stack trace | -- stack trace: | | github.com/apache/incubator-devlake/core/runner.RunPluginSubTasks | | /app/core/runner/run_task.go:333 | | [...repeated from below...] | Wraps: (4) subtask Clone Git Repo ended unexpectedly | Wraps: (5) attached stack trace | -- stack trace: | | github.com/apache/incubator-devlake/plugins/gitextractor/parser.(*GitcliCloner).execCommand | | /app/plugins/gitextractor/parser/clone_gitcli.go:323 | | github.com/apache/incubator-devlake/plugins/gitextractor/parser.(*GitcliCloner).git | | /app/plugins/gitextractor/parser/clone_gitcli.go:311 | | github.com/apache/incubator-devlak e/plugins/gitextractor/parser.(*GitcliCloner).gitClone | | /app/plugins/gitextractor/parser/clone_gitcli.go:273 | | github.com/apache/incubator-devlake/plugins/gitextractor/parser.(*GitcliCloner).shallowClone | | /app/plugins/gitextractor/parser/clone_gitcli.go:224 | | github.com/apache/incubator-devlake/plugins/gitextractor/parser.(*GitcliCloner).CloneRepo | | /app/plugins/gitextractor/parser/clone_gitcli.go:182 | | github.com/apache/incubator-devlake/plugins/gitextractor/tasks.CloneGitRepo | | /app/plugins/gitextractor/tasks/repo_cloner.go:60 | | github.com/apache/incubator-devlake/core/runner.runSubtask | | /app/core/runner/run_task.go:425 | | github.com/apache/incubator-devlake/core/runner.RunPluginSubTasks | | /app/core/runner/run_task.go:330 | | github.com/apache/incubator-devlake/core/runner.RunPluginTask | | /app/core/runner/run_task.go:165 | | github.com/apache/incubator-devlake/core/runner.RunTask | | /app/core/runner/run_task.go:139 | | github.com/apache/incubator-devlake /server/services.runTaskStandalone | | /app/server/services/task_runner.go:114 | | github.com/apache/incubator-devlake/server/services.RunTasksStandalone.func1 | | /app/server/services/task.go:187 | | runtime.goexit | | /usr/local/go/src/runtime/asm_amd64.s:1598 | Wraps: (6) git cmd [git clone https://<user>:*********@<domain>.<domain>/bitbucket/scm/oma/<project_name>.git /tmp/gitextractor4184564856 --depth=1 --bare] in failed: Cloning into bare repository '/tmp/gitextractor4184564856'... | | fatal: Out of memory, malloc failed (tried to allocate 1462922845 bytes) | | fatal: unpack-objects failed | Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.leafError ### What do you expect to happen Refreshes to run through without failing. ### How to reproduce Re-transform Data or Collect Data or Collect data in full refresh a project with bitbucket repos with different amounts of commits and branches. The project also has Jira and Bamboo. ### Anything else The bitbucket project in this ticket had only one initial commit. In another case, the bibucket project had > 100 commits and many branches. The shortened errors are: | fatal: Out of memory, malloc failed (tried to allocate 361795585 bytes) | fatal: index-pack failed Error types: (1) | fatal: Out of memory, malloc failed (tried to allocate 1462922845 bytes) | fatal: unpack-objects failed Error types: (1) | fatal: Out of memory, malloc failed (tried to allocate 481953334 bytes) | fatal: index-pack failed Error types: (1) ### Version v1.0.2-beta4 and v1.0.2-beta5 ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@devlake.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
