Too much load for Atlas from ATLAS_HOOK

2018-02-22 Thread Ă–sterlund Berry
Hi all So' I'm facing a problem that I don't really know how to solve. The core problem is that Atlas don't process the information in the ATLAS_HOOK topic fast enough. So we have a backlog that is growing every day. As we want to use tag-based security in combination with Ranger, we moved away

Re: Too much load for Atlas from ATLAS_HOOK

2018-02-22 Thread Madhan Neethiraj
Berry, Thanks for the details of the issue. It will also help if you can share the number of incoming messages and the number of messages processed by Atlas (like in a day?). Your observations of longer processing times for tables having large number of columns and column-linage are correct.