Re: [Dev] Implementing a Log Agent to send logs to BAM
Hi Anjana, I am in the final part of implementation which is mapping the log line to regular expression and parsing it. Hopefully it will take couple of days. @Suho noted your point Thank you Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Fri, Feb 6, 2015 at 11:53 AM, Sriskandarajah Suhothayan s...@wso2.com wrote: We have written a TCP data publisher I believe Sinthuja will integrate that to the new Data-Bridge data publisher she was writing. we can use that to send logs too Suho On Fri, Feb 6, 2015 at 9:11 AM, Anjana Fernando anj...@wso2.com wrote: Dineepa, what is the status of this?, please do send an update. Cheers, Anjana. On Tue, Jan 20, 2015 at 5:34 PM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi, As to the discussed facts so far, regarding the implementation of Log Agent I have created a class diagram. It is attached here. Thanks for your time Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 1:15 PM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi Chamila, The agent listens to the log files which means it publish events ones the log entry is added. And also it can read the complete logs and publish as well. Initially the agent listens to log files and send events to BAM, but listening to the TCP and UDP to get logs and sending them can be done as a continuation. Thank you Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 12:30 PM, Chamila De Alwis chami...@wso2.com wrote: Hi Dineepa, Would this agent listen to logs in real time and send new lines to BAM or would it parse static files? Furthermore, is there going to be any intermediate processing of the log entries before being passed to BAM? On Mon, Dec 22, 2014 at 11:45 AM, Dineepa Edirisinghe dine...@wso2.com wrote: At the given time I will be considering to write an agent which listens log files, but the agent will be implementing in an extensible way so that the functionality of listening to TCP or UDP and send can be considered later. I didn't quite understand this. Does this mean the agent can act as an intermediary to some remote resource? Regards, Chamila de Alwis Software Engineer | WSO2 | +94772207163 Blog: code.chamiladealwis.com -- *Anjana Fernando* Senior Technical Lead WSO2 Inc. | http://wso2.com lean . enterprise . middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *S. Suhothayan* Technical Lead Team Lead of WSO2 Complex Event Processor *WSO2 Inc. *http://wso2.com * http://wso2.com/* lean . enterprise . middleware *cell: (+94) 779 756 757 %28%2B94%29%20779%20756%20757 | blog: http://suhothayan.blogspot.com/ http://suhothayan.blogspot.com/twitter: http://twitter.com/suhothayan http://twitter.com/suhothayan | linked-in: http://lk.linkedin.com/in/suhothayan http://lk.linkedin.com/in/suhothayan* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Implementing a Log Agent to send logs to BAM
Dineepa, what is the status of this?, please do send an update. Cheers, Anjana. On Tue, Jan 20, 2015 at 5:34 PM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi, As to the discussed facts so far, regarding the implementation of Log Agent I have created a class diagram. It is attached here. Thanks for your time Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 1:15 PM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi Chamila, The agent listens to the log files which means it publish events ones the log entry is added. And also it can read the complete logs and publish as well. Initially the agent listens to log files and send events to BAM, but listening to the TCP and UDP to get logs and sending them can be done as a continuation. Thank you Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 12:30 PM, Chamila De Alwis chami...@wso2.com wrote: Hi Dineepa, Would this agent listen to logs in real time and send new lines to BAM or would it parse static files? Furthermore, is there going to be any intermediate processing of the log entries before being passed to BAM? On Mon, Dec 22, 2014 at 11:45 AM, Dineepa Edirisinghe dine...@wso2.com wrote: At the given time I will be considering to write an agent which listens log files, but the agent will be implementing in an extensible way so that the functionality of listening to TCP or UDP and send can be considered later. I didn't quite understand this. Does this mean the agent can act as an intermediary to some remote resource? Regards, Chamila de Alwis Software Engineer | WSO2 | +94772207163 Blog: code.chamiladealwis.com -- *Anjana Fernando* Senior Technical Lead WSO2 Inc. | http://wso2.com lean . enterprise . middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Implementing a Log Agent to send logs to BAM
We have written a TCP data publisher I believe Sinthuja will integrate that to the new Data-Bridge data publisher she was writing. we can use that to send logs too Suho On Fri, Feb 6, 2015 at 9:11 AM, Anjana Fernando anj...@wso2.com wrote: Dineepa, what is the status of this?, please do send an update. Cheers, Anjana. On Tue, Jan 20, 2015 at 5:34 PM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi, As to the discussed facts so far, regarding the implementation of Log Agent I have created a class diagram. It is attached here. Thanks for your time Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 1:15 PM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi Chamila, The agent listens to the log files which means it publish events ones the log entry is added. And also it can read the complete logs and publish as well. Initially the agent listens to log files and send events to BAM, but listening to the TCP and UDP to get logs and sending them can be done as a continuation. Thank you Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 12:30 PM, Chamila De Alwis chami...@wso2.com wrote: Hi Dineepa, Would this agent listen to logs in real time and send new lines to BAM or would it parse static files? Furthermore, is there going to be any intermediate processing of the log entries before being passed to BAM? On Mon, Dec 22, 2014 at 11:45 AM, Dineepa Edirisinghe dine...@wso2.com wrote: At the given time I will be considering to write an agent which listens log files, but the agent will be implementing in an extensible way so that the functionality of listening to TCP or UDP and send can be considered later. I didn't quite understand this. Does this mean the agent can act as an intermediary to some remote resource? Regards, Chamila de Alwis Software Engineer | WSO2 | +94772207163 Blog: code.chamiladealwis.com -- *Anjana Fernando* Senior Technical Lead WSO2 Inc. | http://wso2.com lean . enterprise . middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *S. Suhothayan* Technical Lead Team Lead of WSO2 Complex Event Processor *WSO2 Inc. *http://wso2.com * http://wso2.com/* lean . enterprise . middleware *cell: (+94) 779 756 757 | blog: http://suhothayan.blogspot.com/ http://suhothayan.blogspot.com/twitter: http://twitter.com/suhothayan http://twitter.com/suhothayan | linked-in: http://lk.linkedin.com/in/suhothayan http://lk.linkedin.com/in/suhothayan* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Implementing a Log Agent to send logs to BAM
Hi, +1 for the features list for the first cut of implementation. @Cloud team: Please add any features, that you may think it'll be useful to have. Thanks, Sinthuja. On Mon, Dec 22, 2014 at 11:45 AM, Dineepa Edirisinghe dine...@wso2.com wrote: Hi, I am currently trying to implement a log agent which listens to log files and send events to BAM. I will be considering the following scope within the time frame. 1. Create configuration file which specifies; the location of the log files to the listening agents, the format of the log files and the end point to which the log file to be sent. Here I will be considering to handle different file formats. 2. Dynamically add above configurations to the agent in a way that the agent is not restarting. 3. Create agent which will handle different formats of logs and also in a way that agent is listening to the log files so that it is sensitive to any new logs that is appending as well as complete logs when publishing. 4. Create agent which will listen to multiple log files. 5. I am also planning to create this as it is working on any Operating System. At the given time I will be considering to write an agent which listens log files, but the agent will be implementing in an extensible way so that the functionality of listening to TCP or UDP and send can be considered later. Thank you for your time Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 -- *Sinthuja Rajendran* Senior Software Engineer http://wso2.com/ WSO2, Inc.:http://wso2.com Blog: http://sinthu-rajan.blogspot.com/ Mobile: +94774273955 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Implementing a Log Agent to send logs to BAM
Hi Dineepa, Would this agent listen to logs in real time and send new lines to BAM or would it parse static files? Furthermore, is there going to be any intermediate processing of the log entries before being passed to BAM? On Mon, Dec 22, 2014 at 11:45 AM, Dineepa Edirisinghe dine...@wso2.com wrote: At the given time I will be considering to write an agent which listens log files, but the agent will be implementing in an extensible way so that the functionality of listening to TCP or UDP and send can be considered later. I didn't quite understand this. Does this mean the agent can act as an intermediary to some remote resource? Regards, Chamila de Alwis Software Engineer | WSO2 | +94772207163 Blog: code.chamiladealwis.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Implementing a Log Agent to send logs to BAM
Hi Chamila, The agent listens to the log files which means it publish events ones the log entry is added. And also it can read the complete logs and publish as well. Initially the agent listens to log files and send events to BAM, but listening to the TCP and UDP to get logs and sending them can be done as a continuation. Thank you Dineepa Edirisinghe Software Engineer-Intern WSO2 Mob: +94 777 867 396 On Tue, Dec 23, 2014 at 12:30 PM, Chamila De Alwis chami...@wso2.com wrote: Hi Dineepa, Would this agent listen to logs in real time and send new lines to BAM or would it parse static files? Furthermore, is there going to be any intermediate processing of the log entries before being passed to BAM? On Mon, Dec 22, 2014 at 11:45 AM, Dineepa Edirisinghe dine...@wso2.com wrote: At the given time I will be considering to write an agent which listens log files, but the agent will be implementing in an extensible way so that the functionality of listening to TCP or UDP and send can be considered later. I didn't quite understand this. Does this mean the agent can act as an intermediary to some remote resource? Regards, Chamila de Alwis Software Engineer | WSO2 | +94772207163 Blog: code.chamiladealwis.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
