AnkeshThakur commented on issue #8501: URL: https://github.com/apache/incubator-devlake/issues/8501#issuecomment-3102897611
Over the course of time, I am also observing that this is taking extremely long time to process DORA metrics. Is there any flag or configuration which can set it run tasks in parallel or in bulk? ``` [GIN] 2025/07/22 - 14:00:32 | 200 | 3.305575ms | 10.220.48.179 | GET "/pipelines/128/tasks" time="2025-07-22 14:00:37" level=info msg=" [pipeline service] [pipeline #128] [task #2926] [calculateChangeLeadTime] finished records: 5151(not exactly)" [GIN] 2025/07/22 - 14:00:37 | 200 | 650ns | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:37 | 200 | 2.71µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:37 | 200 | 4.331136ms | 10.220.48.179 | GET "/pipelines/128" [GIN] 2025/07/22 - 14:00:37 | 200 | 3.71054ms | 10.220.48.179 | GET "/pipelines/128/tasks" [GIN] 2025/07/22 - 14:00:42 | 200 | 2.5µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:42 | 200 | 2.45µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:42 | 200 | 9.670353ms | 10.220.48.179 | GET "/pipelines/128" [GIN] 2025/07/22 - 14:00:42 | 200 | 3.103823ms | 10.220.48.179 | GET "/pipelines/128/tasks" [GIN] 2025/07/22 - 14:00:47 | 200 | 3.36µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:47 | 200 | 2.88µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:47 | 200 | 5.273676ms | 10.220.48.179 | GET "/pipelines/128" [GIN] 2025/07/22 - 14:00:47 | 200 | 3.411076ms | 10.220.48.179 | GET "/pipelines/128/tasks" [GIN] 2025/07/22 - 14:00:52 | 200 | 510ns | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:52 | 200 | 2.82µs | 10.220.45.224 | GET "/ping" time="2025-07-22 14:00:52" level=info msg=" [pipeline service] [pipeline #128] [task #2926] [calculateChangeLeadTime] finished records: 5152(not exactly)" [GIN] 2025/07/22 - 14:00:57 | 200 | 2.43µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:00:57 | 200 | 1.92µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:01:02 | 200 | 2.51µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:01:02 | 200 | 880ns | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:01:07 | 200 | 2.64µs | 10.220.45.224 | GET "/ping" [GIN] 2025/07/22 - 14:01:07 | 200 | 2.64µs | 10.220.45.224 | GET "/ping" time="2025-07-22 14:01:08" level=info msg=" [pipeline service] [pipeline #128] [task #2926] [calculateChangeLeadTime] finished records: 5153(not exactly)" ``` Single record takes around 15 seconds which too slow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@devlake.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
