alexander-bloss opened a new issue, #7694:
URL: https://github.com/apache/incubator-devlake/issues/7694
Hey @warren830, @abeizn !
Maybe I am having a problem with this change. Check it out:
1. I'm working with 2k+ repositories;
2. The refs table has 1GB+ (1.4MM records);
3. There is no rows with data on the created_date column;
4. I'm running Devlake on **v1.0-beta1** version
The problem is:
1. refdiff_task_data.go [lines 128 to 132] selects all values ordering by
'created_date' column which is not indexed;
2. **The 'SELECT * FROM `refs` ORDER BY created_date desc' is taking too
long (15+ minutes) to complete and a simple (5 repositories) Azure DevOps
extraction takes an hour to complete.**
Is there anything I can do to improve/optimize this behaviour?
_Originally posted by @alexander-bloss in
https://github.com/apache/incubator-devlake/issues/1474#issuecomment-2207222757_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@devlake.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
