mounikanakkala opened a new issue #10521: URL: https://github.com/apache/druid/issues/10521
Hello Everyone, We have lookups being updated once in 4 hours to Druid sending POST request for Update, whose size goes up to 50 MB. We are not adding extra set of 50 MB sized lookups in every run. Rather, we may end up updating the same lookup in every run. We do this periodically so that the list is most recent. We have observed that every time there is an update, Druid audits those entries in druid_audit metadata table. 1. Are those audits of any significance to Druid? Especially the ones which are older than recent n entries, say n = 4 ? If we are updating 50 MB worth data once in 4 hours, that metadata would become GBs in few days. We want to prune this audit. 2. Is there a possibility of adding a config to not audit lookups so that this config would automatically not add in the audit table? Please let us know if you need additional information. Thank you for your time. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
