Hi I'm interested in using Flume to store audit logs in HDFS which can then be queried with Hive. I see that the links on the Flume page point to Flume NG which says its not ready for production use yet. Is that still the case?
Our use case would likely look something like this: - 15 servers running a Java web server and logging audit data (1-2K per event, 20-90 events per second per server) - Hadoop running on 5 machine cluster (4x2.4GHz processors, 8GB RAM, 8TB total storage) Its important that all data makes it into HDFS. I'd appreciate any comments on how to proceed with this. Best regards Simon Kelly
