dbwong commented on pull request #1210: URL: https://github.com/apache/phoenix/pull/1210#issuecomment-829497073
> The motivation for the audit logger is to log all data modifications for compliance purposes. > This is a colossal waste of storage and resources, but some users have this legal requirement. > > The goal of the original logging implementation is mostly to provide data for operational purposes and performance optimization. > > For example, in query logging, we only log the parameters at trace levels, while in the audit log we always want to log them, as it's useless without this. > We also don't want to to do statistical logging for audit, as it would defeat its purpose. > > We have serveral things to log (query, paramters, query plan, statistics, etc) > At the extreme end, you could specify what to log for each query type, and specify the logging probability. > (Possibly complicating this by filtering for tables or other objects) > > However, this would be quite a large and awkward matrix to configure. > > The current solution is a relatively simple point solution to add the audit logging capability. > > It does not preclude the possibility of adding a more full-featured and flexible logging implementation later. This is already pushed but I'm a bit worried about how we migrate users on this to the more full-featured and flexible logging implementation without the approaches I mentioned above. We may have to support this into the future even if it isn't really as flexible as we would like. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
