We have a number of web servers in ec2 and periodically we just blow them away and create new ones. That makes keeping logs problematic. We're looking for a way to stream the logs from those various sources directly to a central log server - either just a single server or hdfs or something like that.
My question is whether kafka is a good fit for that or should I be looking more along the lines of flume or scribe? Many thanks. Jeremy
