Hello everyone ! I send you this mail about a question related to the storage HDFS of the audit.
I use Ranger for three plugins first : - HDFS - Kafka - HBase I have two namenodes, two Hbase-masters, 100 region servers and 30 kafka brokers. I notices that I have ony audit file per server per day. My question is the following : will I encounter the famous "small files problem" with my namenodes because of the number of small audit files stored in HDFS ? Is there a way to configure the frequence when the audit are put into HDFS ? Or a way to configure ranger to store files corresponding to multiple days ? Is there a way to purge them natively (I developed a shell script and scheduled it on crontab but if there is a native mechanism) ? BR. Lune
