Ryan Merriman created METRON-498:
------------------------------------

             Summary: Yaf doesn't pick up updated patterns from the hdfs
                 Key: METRON-498
                 URL: https://issues.apache.org/jira/browse/METRON-498
             Project: Metron
          Issue Type: Bug
            Reporter: Ryan Merriman
            Assignee: Ryan Merriman


Grok patterns are kept in HDFS and referenced by path in a Zookeeper config 
property.  There is no way to update a pattern and have that change seen in the 
ParserBolt without restarting the topology.

As discussed on the dev list, a better approach is to instead store the grok 
patterns directly in zookeeper.  The requirements mentioned in that discussion:
- pattern files removed from HDFS and classpath
- update to grok pattern in zookeeper is immediately applied in bolt
- ability to easily edit the pattern



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to