Re: [heka] multiple file upload using HEKA

2016-04-14 Thread Rob Miller
No, if you have fifty separate, unrelated log streams you need fifty separate LogstreamerInputs. If they're all living in the same location it should be pretty easy to script your config generation. -r On 04/07/2016 12:27 AM, Abhiman wrote: > If I understand what you're saying, you're using

Re: [heka] multiple file upload using HEKA

2016-04-07 Thread Abhiman
> If I understand what you're saying, you're using LogstreamerInput > incorrectly. A single LogstreamerInput is meant to map to either a > single log stream, or possibly multiple logstreams of identical > structure, such as a set of access logs for a number of different domains. > > You seem

Re: [heka] multiple file upload using HEKA

2016-04-06 Thread Mathieu Parent
2016-04-06 20:23 GMT+02:00 Rob Miller : > If I understand what you're saying, you're using LogstreamerInput > incorrectly. A single LogstreamerInput is meant to map to either a single > log stream, or possibly multiple logstreams of identical structure, such as > a set of

Re: [heka] multiple file upload using HEKA

2016-04-06 Thread Iñigo Ortiz de Urbina
Merhaba Abhiman If you are having trouble making heka work, I recommend you do some "bottom-up" debugging to check every stage, from input to output. At the very least: - is ´heka-logstreamer -config=/etc/heka/test.toml´ yielding the expected output? If it does not show what you want, iterate

[heka] multiple file upload using HEKA

2016-04-06 Thread Abhiman
I want to upload multiple files(which are non sequential) simultaneously using Heka. The files are conn.log, http.log, dhcp.log, dnp3.log, ftp.log, dns.log. I am trying with the following code [networklogs] Type = "LogstreamerInput" log_directory = "/opt/bro/logs/current" file_match=