Matt, Thank you for taking the time to reply. Ryan has helped me off list and the issue is that the topology.classpath ‘custom property’ was not set in the cluster when deployed.
I am going to have the folks go through the ansible log to see if there is mention of it. I will try to find out if there was something during deployment that they overlooks or not and comment on this thread. On November 22, 2016 at 16:00:44, Matt Foley ([email protected]) wrote: Hi Otto, Please send the output from hdfs dfs -ls /apps/metron/patterns/ so we can see what the permissions are. Also, what is the current value of fs.defaultFS property in (server local filesystem) /etc/hadoop/conf/core-site.xml ? And are you running Metron in the typical way, under Ambari? Thanks, --Matt On 11/22/16, 9:58 AM, "Otto Fowler" <[email protected]> wrote: Would that be true if you could actually see the files in hdfs using other means? On November 22, 2016 at 12:27:18, Ryan Merriman ([email protected]) wrote: My guess is that either /apps/metron/patterns/squid was somehow removed from HDFS or the HDSF url isn¹t configured properly. I believe that url comes from the fs.defaultFS property in /etc/hadoop/conf/core-site.xml. Ryan On 11/22/16, 11:14 AM, "Otto Fowler" <[email protected]> wrote: >Anyone ever see this? > >2016-11-21 16:21:43.197 o.a.h.u.NativeCodeLoader [WARN] Unable to load >native-hadoop library for your platform... using builtin-java classes >where >applicable >2016-11-21 16:21:43.354 o.a.m.p.GrokParser [ERROR] Grok parser unable to >initialize grok parser: Unable to load /apps/metron/patterns/squid from >either classpath or HDFS >java.lang.RuntimeException: Grok parser unable to initialize grok parser: >Unable to load /apps/metron/patterns/squid from either classpath or HDFS > at org.apache.metron.parsers.GrokParser.init(GrokParser.java:109) >[stormjar.jar:?] > at >org.apache.metron.parsers.bolt.ParserBolt.prepare(ParserBolt.java:86) >[stormjar.jar:?] > at >backtype.storm.daemon.executor$fn__6259$fn__6272.invoke(executor.clj:751) >[storm-core-0.10.0.2.4.3.0-227.jar:0.10.0.2.4.3.0-227] > at backtype.storm.util$async_loop$fn__545.invoke(util.clj:477) >[storm-core-0.10.0.2.4.3.0-227.jar:0.10.0.2.4.3.0-227] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_60] >2016-11-21 16:21:43.358 b.s.util [ERROR] Async loop died! >java.lang.RuntimeException: Grok parser Error: Grok parser unable to >initialize grok parser: Unable to load /apps/metron/patterns/squid from >either classpath or HDFS > at org.apache.metron.parsers.GrokParser.init(GrokParser.java:127) >~[stormjar.jar:?] > at >org.apache.metron.parsers.bolt.ParserBolt.prepare(ParserBolt.java:86) >~[stormjar.jar:?] > at >backtype.storm.daemon.executor$fn__6259$fn__6272.invoke(executor.clj:751) >~[storm-core-0.10.0.2.4.3.0-227.jar:0.10.0.2.4.3.0-227] > at backtype.storm.util$async_loop$fn__545.invoke(util.clj:477) >[storm-core-0.10.0.2.4.3.0-227.jar:0.10.0.2.4.3.0-227] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_60] >Caused by: java.lang.RuntimeException: Grok parser unable to initialize >grok parser: Unable to load /apps/metron/patterns/squid from either >classpath or HDFS > at org.apache.metron.parsers.GrokParser.init(GrokParser.java:109) >~[stormjar.jar:?] > ... 5 more > > >2.1Beta rc2
