Ryan Merriman created METRON-498:

             Summary: Yaf doesn't pick up updated patterns from the hdfs
                 Key: METRON-498
                 URL: https://issues.apache.org/jira/browse/METRON-498
             Project: Metron
          Issue Type: Bug
            Reporter: Ryan Merriman
            Assignee: Ryan Merriman

Grok patterns are kept in HDFS and referenced by path in a Zookeeper config 
property.  There is no way to update a pattern and have that change seen in the 
ParserBolt without restarting the topology.

As discussed on the dev list, a better approach is to instead store the grok 
patterns directly in zookeeper.  The requirements mentioned in that discussion:
- pattern files removed from HDFS and classpath
- update to grok pattern in zookeeper is immediately applied in bolt
- ability to easily edit the pattern

This message was sent by Atlassian JIRA

Reply via email to