Liam-Sturge opened a new issue, #16549:
URL: https://github.com/apache/tvm/issues/16549

   Jobs that require an arm agent are struggling to find an Graviton-3 executor 
in Jenkins. There are hundreds of builds queued for ci-arm. Some of the builds 
queued are stuck. This appears to have started on 8th February.
   
   ### Branch/PR Failing
   
   https://github.com/apache/tvm/pull/16183 may have caused the backlog of 
jobs. Recently a large amount of commits were pushed simultaneously for this PR 
and builds have been scheduled for each commit. I have attached a graph of the 
agent queue and allocation, which shows a big spike in queued jobs.
   
   
![graviton3_executors](https://github.com/apache/tvm/assets/50229489/6a560b01-f349-4828-9fd4-b51ff46c2afc)
   
   ### Jenkins Link
   
   Build logs on these jobs indicate that some of the builds are stuck. They 
have ended with an unfinished status, but remain in the queue. See this console 
log as one example of many:
   
   https://ci.tlcpack.ai/job/tvm-arm/job/PR-16183/495/console
   
   ### Triage
   
   Please refer to the list of label tags 
[here](https://github.com/apache/tvm/wiki/Issue-Triage-Labels) to find the 
relevant tags and add them below in a bullet format (example below).
   
   * needs-triage
   
   CC @lhutton1 @konturn @tqchen @yongwww 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to