kkc-tonywu opened a new issue, #8187: URL: https://github.com/apache/incubator-devlake/issues/8187
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues. ### What happened The number of GitLab Repo MRs/CI/CD... in our system exceeds 10,000. According to the official GitLab documentation: > For performance reasons, if a query returns more than 10,000 records, GitLab excludes some headers. > ref: [GitLab Documentation](https://docs.gitlab.com/ee/user/gitlab_com/index.html#pagination-response-headers) As a result, the `x-total-page` header is not returned, which causes Develake to only fetch 100 records for the subtask. ### What do you expect to happen No matter the settings, it is necessary to retrieve the complete data. ### How to reproduce When MR, Pipeline, and Deployment are executed tens of thousands of times, attempting to retrieve the data afterwards will only return 100 records. ### Anything else _No response_ ### Version 1.0.1 ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@devlake.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
