Hi,
I defined a profile definition for my requirement to perform profile
statistics. The calculation of profiler statistics for current profiling period
will depend on the previous profile flushed stats.
So, I am trying to read the previous stats during initialization ( "init" field
in json ) part of profile for the current profiling period.
The definition works fine when there are profile stats from the previous
period, which means my profile definition working fine for first 15 minutes (my
profile period is set to 15 mins). When profiler flushes the profile stats into
hbase for first 15 minutes and starts for next period, I am getting the parse
exception as seen in attached doc at Profiler topology and SplitterBolt.
I have executed all lines of code in the stellar shell (instantiated with
zookeeper config ./bin/stellat -z XXXX). It works fine without any issues in
all the cases. Which means, I am able to fetch the previous profile stats,
initialize for current record and execute all lines of code in profiler
definition with expected result.
I could not able to figure out what else is going wrong during SplitterBolt
execution. I request someone to go through the attached logs and help me to
troubleshoot the issue further.
High Level Exception stack trace:
*************************************** Exception seen at profiler
topology logs *******************************
2018-04-27 10:56:06.483 o.a.h.m.s.s.StormTimelineMetricsSink Thread-23 [WARN]
Unable to send metrics to collector by
address:http://null:6188/ws/v1/timeline/metrics
2018-04-27 10:57:16.575 o.a.m.p.b.ProfileSplitterBolt
Thread-6-splitterBolt-executor[7 7] [ERROR] Unexpected failure: message='null',
tuple='{value=[123,***********Lot of integer values here in the logs end
with****34, 48, 34, 125]}'
org.json.simple.parser.ParseException: null
at org.json.simple.parser.Yylex.yylex(Yylex.java:610)
~[stormjar.jar:?]
at
org.json.simple.parser.JSONParser.nextToken(JSONParser.java:269)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:118)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:81)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:75)
~[stormjar.jar:?]
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.doExecute(ProfileSplitterBolt.java:108)
~[stormjar.jar:?]
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.execute(ProfileSplitterBolt.java:94)
[stormjar.jar:?]
at
org.apache.storm.daemon.executor$fn__10250$tuple_action_fn__10252.invoke(executor.clj:730)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:462)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.daemon.executor$fn__10250$fn__10263$fn__10316.invoke(executor.clj:849)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
****************************** Exception at SplitterBolt:
***********************
Unexpected character (.) at position 885. at
org.json.simple.parser.Yylex.yylex(Yylex.java:610) at
org.json.simple.parser.JSONParser.nextToken(JSONParser.java:269) at
org.json.simple.parser.JSONParser.parse(JSONParser.java:118) at
org.json.simple.parser.JSONParser.parse(JSONParser.java:81) at
org.json.simple.parser.JSONParser.parse(JSONParser.java:75) at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.doExecute(ProfileSplitterBolt.java:108)
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.execute(ProfileSplitterBolt.java:94)
at
org.apache.storm.daemon.executor$fn__10250$tuple_action_fn__10252.invoke(executor.clj:730)
at
org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:462)
at
org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40)
at
org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472)
at
org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451)
at
org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
at
org.apache.storm.daemon.executor$fn__10250$fn__10263$fn__10316.invoke(executor.clj:849)
at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484) at
clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.java:748)
Thanks,
Anil.
*************************************** Exception seen at profiler topology
logs *******************************
2018-04-27 10:56:06.483 o.a.h.m.s.s.StormTimelineMetricsSink Thread-23 [WARN]
Unable to send metrics to collector by
address:http://null:6188/ws/v1/timeline/metrics
2018-04-27 10:57:16.575 o.a.m.p.b.ProfileSplitterBolt
Thread-6-splitterBolt-executor[7 7] [ERROR] Unexpected failure: message='null',
tuple='{value=[123, 34, 112, 99, 107, 116, 95, 108, 101, 110, 34, 58, 34, 48,
34, 44, 34, 114, 97, 119, 95, 105, 100, 34, 58, 34, 49, 55, 53, 49, 56, 56, 56,
54, 34, 44, 34, 101, 110, 114, 105, 99, 104, 109, 101, 110, 116, 115, 112, 108,
105, 116, 116, 101, 114, 98, 111, 108, 116, 46, 115, 112, 108, 105, 116, 116,
101, 114, 46, 101, 110, 100, 46, 116, 115, 34, 58, 34, 49, 53, 50, 52, 56, 52,
49, 48, 51, 54, 51, 56, 52, 34, 44, 34, 97, 100, 97, 112, 116, 101, 114, 46,
115, 116, 101, 108, 108, 97, 114, 97, 100, 97, 112, 116, 101, 114, 46, 101,
110, 100, 46, 116, 115, 34, 58, 34, 49, 53, 50, 52, 56, 52, 49, 48, 51, 54, 51,
56, 54, 34, 44, 34, 101, 110, 114, 105, 99, 104, 109, 101, 110, 116, 115, 112,
108, 105, 116, 116, 101, 114, 98, 111, 108, 116, 46, 115, 112, 108, 105, 116,
116, 101, 114, 46, 98, 101, 103, 105, 110, 46, 116, 115, 34, 58, 34, 49, 53,
50, 52, 56, 52, 49, 48, 51, 54, 51, 55, 55, 34, 44, 34, 109, 97, 120, 95, 108,
97, 116, 101, 114, 97, 108, 95, 100, 101, 112, 116, 104, 34, 58, 53, 44, 34,
100, 105, 115, 112, 34, 58, 34, 49, 34, 44, 34, 100, 115, 116, 95, 105, 112,
34, 58, 34, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 56, 34, 44, 34, 105,
110, 102, 111, 95, 53, 34, 58, 34, 100, 117, 114, 97, 116, 105, 111, 110, 61,
51, 48, 59, 32, 115, 101, 110, 116, 95, 98, 121, 116, 101, 115, 61, 54, 49, 59,
32, 114, 99, 118, 100, 95, 98, 121, 116, 101, 115, 61, 49, 48, 52, 34, 44, 34,
115, 105, 100, 34, 58, 34, 50, 48, 52, 57, 51, 48, 48, 55, 51, 56, 34, 44, 34,
105, 110, 102, 111, 95, 54, 34, 58, 34, 115, 114, 99, 95, 117, 115, 101, 114,
61, 116, 101, 106, 97, 46, 98, 97, 121, 97, 110, 101, 110, 105, 64, 115, 115,
116, 101, 99, 104, 46, 105, 110, 116, 101, 114, 110, 97, 108, 34, 44, 34, 115,
114, 99, 95, 105, 112, 34, 58, 34, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49,
55, 34, 44, 34, 100, 115, 116, 95, 105, 110, 116, 102, 34, 58, 34, 49, 45, 77,
65, 73, 78, 32, 76, 65, 78, 34, 44, 34, 112, 114, 111, 116, 111, 99, 111, 108,
34, 58, 34, 100, 110, 115, 92, 47, 117, 100, 112, 34, 44, 34, 108, 111, 103,
95, 116, 121, 112, 101, 34, 58, 34, 116, 114, 34, 44, 34, 100, 111, 109, 97,
105, 110, 115, 95, 99, 111, 117, 110, 116, 34, 58, 48, 44, 34, 111, 114, 105,
103, 105, 110, 97, 108, 95, 115, 116, 114, 105, 110, 103, 34, 58, 34, 50, 48,
52, 57, 51, 48, 48, 55, 51, 56, 44, 92, 34, 92, 34, 44, 56, 48, 66, 69, 48, 55,
65, 66, 53, 57, 55, 66, 50, 44, 51, 48, 48, 48, 45, 48, 49, 53, 49, 44, 49, 48,
50, 52, 44, 49, 55, 53, 49, 56, 56, 56, 54, 44, 49, 44, 48, 44, 54, 44, 65,
108, 108, 111, 119, 45, 83, 83, 76, 86, 80, 78, 45, 85, 115, 101, 114, 115, 45,
48, 48, 44, 100, 110, 115, 92, 47, 117, 100, 112, 44, 49, 48, 46, 49, 48, 46,
49, 49, 48, 46, 49, 55, 44, 52, 49, 48, 55, 57, 44, 49, 48, 46, 49, 48, 46, 49,
49, 48, 46, 49, 56, 44, 53, 51, 44, 92, 34, 92, 34, 44, 48, 44, 92, 34, 92, 34,
44, 48, 44, 48, 45, 83, 83, 76, 45, 86, 80, 78, 44, 49, 45, 77, 65, 73, 78, 32,
76, 65, 78, 44, 49, 48, 54, 44, 48, 44, 48, 44, 92, 34, 92, 34, 44, 92, 34, 92,
34, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 92, 34, 92,
34, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 100, 117,
114, 97, 116, 105, 111, 110, 61, 51, 48, 59, 32, 115, 101, 110, 116, 95, 98,
121, 116, 101, 115, 61, 54, 49, 59, 32, 114, 99, 118, 100, 95, 98, 121, 116,
101, 115, 61, 49, 48, 52, 44, 115, 114, 99, 95, 117, 115, 101, 114, 61, 116,
101, 106, 97, 46, 98, 97, 121, 97, 110, 101, 110, 105, 64, 115, 115, 116, 101,
99, 104, 46, 105, 110, 116, 101, 114, 110, 97, 108, 44, 92, 34, 92, 34, 44, 92,
34, 92, 34, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 92,
34, 92, 34, 44, 116, 114, 44, 92, 34, 92, 34, 44, 92, 34, 92, 34, 44, 50, 48,
49, 55, 45, 48, 53, 45, 50, 53, 32, 50, 51, 58, 50, 54, 58, 53, 51, 34, 44, 34,
108, 97, 116, 101, 114, 97, 108, 95, 109, 111, 118, 101, 115, 34, 58, 91, 49,
48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 48, 44, 49, 48, 46, 49, 48, 46, 49, 49,
48, 46, 49, 49, 44, 32, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 48, 44, 49,
48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 49, 44, 49, 48, 46, 49, 48, 46, 49, 49,
48, 46, 49, 50, 44, 32, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 48, 44, 49,
48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 49, 44, 49, 48, 46, 49, 48, 46, 49, 49,
48, 46, 49, 50, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 51, 44, 32, 49,
48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 48, 44, 49, 48, 46, 49, 48, 46, 49, 49,
48, 46, 49, 49, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 50, 44, 49, 48,
46, 49, 48, 46, 49, 49, 48, 46, 49, 51, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48,
46, 49, 52, 44, 32, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 48, 44, 49, 48,
46, 49, 48, 46, 49, 49, 48, 46, 49, 49, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48,
46, 49, 50, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 51, 44, 49, 48, 46,
49, 48, 46, 49, 49, 48, 46, 49, 52, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46,
49, 53, 44, 32, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 54, 44, 49, 48, 46,
49, 48, 46, 49, 49, 48, 46, 49, 55, 93, 44, 34, 116, 104, 114, 101, 97, 116,
105, 110, 116, 101, 108, 106, 111, 105, 110, 98, 111, 108, 116, 46, 106, 111,
105, 110, 101, 114, 46, 116, 115, 34, 58, 34, 49, 53, 50, 52, 56, 52, 49, 48,
51, 54, 53, 54, 51, 34, 44, 34, 105, 115, 95, 108, 97, 116, 101, 114, 97, 108,
95, 117, 115, 101, 114, 34, 58, 116, 114, 117, 101, 44, 34, 101, 110, 114, 105,
99, 104, 109, 101, 110, 116, 106, 111, 105, 110, 98, 111, 108, 116, 46, 106,
111, 105, 110, 101, 114, 46, 116, 115, 34, 58, 34, 49, 53, 50, 52, 56, 52, 49,
48, 51, 54, 51, 56, 56, 34, 44, 34, 116, 97, 103, 95, 105, 100, 34, 58, 34, 49,
48, 50, 52, 34, 44, 34, 116, 104, 114, 101, 97, 116, 105, 110, 116, 101, 108,
115, 112, 108, 105, 116, 116, 101, 114, 98, 111, 108, 116, 46, 115, 112, 108,
105, 116, 116, 101, 114, 46, 98, 101, 103, 105, 110, 46, 116, 115, 34, 58, 34,
49, 53, 50, 52, 56, 52, 49, 48, 51, 54, 51, 57, 48, 34, 44, 34, 115, 110, 34,
58, 34, 56, 48, 66, 69, 48, 55, 65, 66, 53, 57, 55, 66, 50, 34, 44, 34, 115,
114, 99, 95, 105, 110, 116, 102, 34, 58, 34, 48, 45, 83, 83, 76, 45, 86, 80,
78, 34, 44, 34, 115, 117, 115, 112, 101, 99, 116, 101, 100, 95, 108, 97, 116,
101, 114, 97, 108, 95, 109, 111, 118, 101, 109, 101, 110, 116, 115, 34, 58, 91,
34, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 48, 44, 49, 48, 46, 49, 48, 46,
49, 49, 48, 46, 49, 49, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 50, 44,
49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 51, 44, 49, 48, 46, 49, 48, 46, 49,
49, 48, 46, 49, 52, 44, 49, 48, 46, 49, 48, 46, 49, 49, 48, 46, 49, 53, 34, 93,
44, 34, 105, 115, 95, 104, 105, 103, 104, 95, 118, 101, 108, 111, 99, 105, 116,
121, 95, 117, 115, 101, 114, 34, 58, 102, 97, 108, 115, 101, 44, 34, 97, 100,
97, 112, 116, 101, 114, 46, 115, 116, 101, 108, 108, 97, 114, 97, 100, 97, 112,
116, 101, 114, 46, 98, 101, 103, 105, 110, 46, 116, 115, 34, 58, 34, 49, 53,
50, 52, 56, 52, 49, 48, 51, 54, 51, 56, 54, 34, 44, 34, 100, 105, 114, 101, 99,
116, 105, 111, 110, 34, 58, 34, 48, 34, 44, 34, 112, 111, 108, 105, 99, 121,
34, 58, 34, 65, 108, 108, 111, 119, 45, 83, 83, 76, 86, 80, 78, 45, 85, 115,
101, 114, 115, 45, 48, 48, 34, 44, 34, 116, 105, 109, 101, 115, 116, 97, 109,
112, 34, 58, 49, 52, 57, 53, 55, 54, 57, 50, 49, 51, 48, 48, 48, 44, 34, 100,
115, 116, 95, 112, 111, 114, 116, 95, 110, 97, 116, 34, 58, 34, 48, 34, 44, 34,
100, 34, 58, 50, 53, 44, 34, 112, 114, 105, 34, 58, 34, 54, 34, 44, 34, 112,
114, 111, 102, 105, 108, 101, 95, 117, 115, 101, 114, 110, 97, 109, 101, 34,
58, 34, 116, 101, 106, 97, 46, 98, 97, 121, 97, 110, 101, 110, 105, 64, 115,
115, 116, 101, 99, 104, 46, 105, 110, 116, 101, 114, 110, 97, 108, 34, 44, 34,
105, 115, 95, 97, 108, 101, 114, 116, 34, 58, 34, 116, 114, 117, 101, 34, 44,
34, 109, 34, 58, 52, 44, 34, 116, 116, 108, 34, 58, 34, 48, 34, 44, 34, 115,
111, 117, 114, 99, 101, 46, 116, 121, 112, 101, 34, 58, 34, 100, 101, 109, 111,
95, 119, 103, 116, 114, 97, 102, 102, 105, 99, 34, 44, 34, 115, 114, 99, 95,
112, 111, 114, 116, 34, 58, 34, 52, 49, 48, 55, 57, 34, 44, 34, 114, 99, 34,
58, 34, 49, 48, 54, 34, 44, 34, 116, 104, 114, 101, 97, 116, 105, 110, 116,
101, 108, 115, 112, 108, 105, 116, 116, 101, 114, 98, 111, 108, 116, 46, 115,
112, 108, 105, 116, 116, 101, 114, 46, 101, 110, 100, 46, 116, 115, 34, 58, 34,
49, 53, 50, 52, 56, 52, 49, 48, 51, 54, 53, 51, 56, 34, 44, 34, 100, 115, 116,
95, 112, 111, 114, 116, 34, 58, 34, 53, 51, 34, 44, 34, 121, 34, 58, 50, 48,
49, 55, 44, 34, 103, 117, 105, 100, 34, 58, 34, 101, 100, 50, 98, 56, 50, 55,
57, 45, 51, 49, 101, 54, 45, 52, 97, 99, 97, 45, 56, 52, 54, 54, 45, 48, 50,
102, 56, 102, 97, 56, 52, 48, 52, 48, 49, 34, 44, 34, 115, 114, 99, 95, 112,
111, 114, 116, 95, 110, 97, 116, 34, 58, 34, 48, 34, 125]}'
org.json.simple.parser.ParseException: null
at org.json.simple.parser.Yylex.yylex(Yylex.java:610) ~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.nextToken(JSONParser.java:269)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:118)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:81)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:75)
~[stormjar.jar:?]
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.doExecute(ProfileSplitterBolt.java:108)
~[stormjar.jar:?]
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.execute(ProfileSplitterBolt.java:94)
[stormjar.jar:?]
at
org.apache.storm.daemon.executor$fn__10250$tuple_action_fn__10252.invoke(executor.clj:730)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:462)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.daemon.executor$fn__10250$fn__10263$fn__10316.invoke(executor.clj:849)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
2018-04-27 10:57:16.576 o.a.s.d.executor Thread-6-splitterBolt-executor[7 7]
[ERROR]
org.json.simple.parser.ParseException: null
at org.json.simple.parser.Yylex.yylex(Yylex.java:610) ~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.nextToken(JSONParser.java:269)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:118)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:81)
~[stormjar.jar:?]
at org.json.simple.parser.JSONParser.parse(JSONParser.java:75)
~[stormjar.jar:?]
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.doExecute(ProfileSplitterBolt.java:108)
~[stormjar.jar:?]
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.execute(ProfileSplitterBolt.java:94)
[stormjar.jar:?]
at
org.apache.storm.daemon.executor$fn__10250$tuple_action_fn__10252.invoke(executor.clj:730)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:462)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at
org.apache.storm.daemon.executor$fn__10250$fn__10263$fn__10316.invoke(executor.clj:849)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484)
[storm-core-1.1.0.2.6.3.0-235.jar:1.1.0.2.6.3.0-235]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
****************************** Exception at SplitterBolt:
***********************
Unexpected character (.) at position 885. at
org.json.simple.parser.Yylex.yylex(Yylex.java:610) at
org.json.simple.parser.JSONParser.nextToken(JSONParser.java:269) at
org.json.simple.parser.JSONParser.parse(JSONParser.java:118) at
org.json.simple.parser.JSONParser.parse(JSONParser.java:81) at
org.json.simple.parser.JSONParser.parse(JSONParser.java:75) at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.doExecute(ProfileSplitterBolt.java:108)
at
org.apache.metron.profiler.bolt.ProfileSplitterBolt.execute(ProfileSplitterBolt.java:94)
at
org.apache.storm.daemon.executor$fn__10250$tuple_action_fn__10252.invoke(executor.clj:730)
at
org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:462)
at
org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40)
at
org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472)
at
org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451)
at
org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73)
at
org.apache.storm.daemon.executor$fn__10250$fn__10263$fn__10316.invoke(executor.clj:849)
at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484) at
clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.java:748)
{
"profiles": [
{
"profile": "test-profile",
"onlyif": "source.type == 'demo_test'",
"foreach": "TO_LOWER(if EXISTS(info_6) then REGEXP_GROUP_VAL(info_6,
'src_user=([^ ]+)', 1) else REGEXP_GROUP_VAL(info_3, 'src_user=([^ ]+)', 1))",
"init": {
"lateral_init_set":
"PROFILE_GET('list-of-domains-per-user', TO_LOWER(if EXISTS(info_6) then
REGEXP_GROUP_VAL(info_6, 'src_user=([^ ]+)', 1) else REGEXP_GROUP_VAL(info_3,
'src_user=([^ ]+)', 1)), PROFILE_FIXED(240, 'HOURS'))",
"domains_set": "if
LENGTH(lateral_init_set) > 0 then SET_INIT(lateral_init_set) else SET_INIT()"
},
"update": { "domains_set": "SET_ADD(domains_set,
REGEXP_GROUP_VAL(info_5, 'dstname=([^ ]+)', 1))" },
"result": {
"profile" : "domains_set"
}
}
]
}
