keon94 commented on issue #6401: URL: https://github.com/apache/incubator-devlake/issues/6401#issuecomment-1806952550
I've recreated this problem by generating a dummy list of about 500 repos. Basically it boils down to a huge payload size being sent from Python to Go, which is either extremely slow or silently fails somewhere. This is pretty simple to solve with the stream API I've created in the past for Go<->Python. This way repos will be sent one by one (tested and works in just a few seconds). A better solution is to stream groups of repos in batches for better efficiency which I am looking into right now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
