shubhampatel28 opened a new issue, #14353:
URL: https://github.com/apache/hudi/issues/14353
### Task Description
**What needs to be done:**
Add a SamplingLogger utility class that logs at INFO level once every N
times, otherwise at DEBUG level. Apply it to high-frequency log statements in
AbstractTableFileSystemView:
- "Building file system view for partition(s)" - DEBUG for metadata
tables, INFO every 10th time for data tables
- "Took X ms to read Y instants, Z replaced file groups" - INFO every 5th
time
**Why this task is needed:**
In high-throughput scenarios with many partitions, these log statements
generate excessive volume at INFO level, making it difficult to identify
important events and increasing log storage costs. Sampling maintains periodic
visibility for monitoring while reducing log volume by 80-90%.
### Task Type
Code improvement/refactoring
### Related Issues
**Parent feature issue:** (if applicable )
**Related issues:**
NOTE: Use `Relationships` button to add parent/blocking issues after issue
is created.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
