[
https://issues.apache.org/jira/browse/CHUKWA-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917370#action_12917370
]
Eric Yang commented on CHUKWA-530:
----------------------------------
I am thinking to add more configure parameters to Chukwa Agent config file.
i.e.:
Trigger for adding syslog adaptor
{noformat}
add SyslogAdaptor SYSLOG 9095 0
{noformat}
SyslogAdaptor would look up:
{noformat}
<property>
<name>syslog.adaptor.[port].[facility name]</name>
<value>[chukwa data type]</value>
</property>
{noformat}
Example:
{noformat}
<property>
<name>syslog.adaptor.9095.LOCAL0</name>
<value>HADOOP</value>
</property>
<property>
<name>syslog.adaptor.9095.LOCAL1</name>
<value>HadoopMetrics</value>
</property>
<property>
<name>syslog.adaptor.9095.AUDIT</name>
<value>AUDITLOG</value>
</property>
{noformat}
This means each udp port can host up to 24 data types. Make sense?
> Syslog Adaptor for mapping Syslog facility name to Chukwa data type
> -------------------------------------------------------------------
>
> Key: CHUKWA-530
> URL: https://issues.apache.org/jira/browse/CHUKWA-530
> Project: Chukwa
> Issue Type: New Feature
> Components: data collection
> Environment: Java 6, Mac OS X
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-530-draft.patch
>
>
> UDPAdaptor can record syslog logs but the log entry is tagged with Chukwa
> internal data type at adaptor start up time. I am thinking to extend
> UDPAdaptor to record syslog messages with small enhancements. SyslogAdaptor
> can extract facility name field from syslog message to tag facility name as
> the data type. This would provide the ability to invoke different demux
> parsers base on the facility name in syslog. HOSTNAME can also be mapped to
> source for Chukwa chunk meta data.
> My use case is to configure hadoop log4j.properties to log everything through
> org.apache.log4j.net.SyslogAppender to one SysLogAdaptor on the local Chukwa
> agent, and invokes different parsers for audit log and name node log.
> Facility name is some what limited, but it should be enough type left to
> manage hadoop log files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
