likyh opened a new issue, #3708: URL: https://github.com/apache/incubator-devlake/issues/3708
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues. ### What happened  sometimes PrCollector in graphql will raise 502. ### What do you expect to happen collect success. ### How to reproduce 1. use graphql_github to collect `https://github.com/apache/jackrabbit-oak` 2. it will raise 502. ### Anything else The reason is too much data on each page. Now 30 pr, 30 * most 100 commits will bind to one graphql query. But I think it will be too slow if set to less than 30 pr per page. In past, the number is 100 pr per page. Maybe we need a dynamic page size. It could request 100 per page and reduce less if 502 got. ### Version main ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
