Re: [logging] Re: EFK logging stack: including the Kafka output plugin and the multiline aggregation plugin

2018-08-20 Thread Rich Megginson
Thanks for this!  Will follow up in the PRs. On 08/20/2018 01:47 AM, Alessandro Menti wrote: Hi Rich And Louis, Please submit PRs against origin-aggregated-logging and openshift-ansible.  Note that for origin-aggregated-logging we will require integration testing, which may require the

Re: EFK logging stack: including the Kafka output plugin and the multiline aggregation plugin

2018-07-18 Thread Rich Megginson
Please submit PRs against origin-aggregated-logging and openshift-ansible.  Note that for origin-aggregated-logging we will require integration testing, which may require the installation of kafka by the test, and some form of documentation i.e. a markdown doc for the docs/ subdir. To

Re: EFK logging stack: including the Kafka output plugin and the multiline aggregation plugin

2018-07-18 Thread Louis Santillan
You can find the EFK project here ( https://github.com/openshift/origin-aggregated-logging). ___ LOUIS P. SANTILLAN Architect, OPENSHIFT, MIDDLEWARE & DEVOPS Red Hat Consulting, Container and PaaS Practice

EFK logging stack: including the Kafka output plugin and the multiline aggregation plugin

2018-07-18 Thread Alessandro Menti
Hi everyone, a customer of ours uses aggregated logging on the OpenShift platform and has two needs: - forwarding all logs to an external Kafka instance; - aggregating multiline logs (e.g. Java stack traces) on the fluentd side before sending them to Kafka. I have packaged the Fluentd gems