sstojak1 opened a new issue, #8276: URL: https://github.com/apache/incubator-devlake/issues/8276
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar feature requirement. ### Use case As a developer, I want to avoid having excessively large raw/tool tables in DevLake, as they consume significant storage and may impact performance. I would prefer a mechanism to manage these tables efficiently, such as automatic deletion or truncation of old records, to keep the system optimized. ### Description Is it possible for DevLake to automatically delete or truncate non-domain tables? My understanding is that raw/tool tables are only required to transform data into domain tables. Once the data is transformed and pushed to domain tables, older records (beyond the most recent import) are no longer used. We’re importing a large number of Jira boards (around 100) frequently, which is causing these raw tables to grow significantly. This issue isn't limited to Jira but applies to all tools supported by DevLake. I’ve attached a screenshot showing an overview of the sizes for all our tables for reference. <img width="1167" alt="Image" src="https://github.com/user-attachments/assets/6ad4350a-e89f-4560-8ca6-045c9623199d"; /> ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@devlake.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
