[
https://issues.apache.org/jira/browse/METRON-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631674#comment-16631674
]
ASF GitHub Bot commented on METRON-1782:
----------------------------------------
Github user MohanDV commented on the issue:
https://github.com/apache/metron/pull/1202
+1 Verified on the full dev , below are the debug log from profiler
`2018-09-28 10:17:36.465 o.a.m.p.b.ProfileSplitterBolt
Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing,
partition=0, offset=5490, kafkaTimestamp=1538129856340
.......
2018-09-28 10:17:43.893 o.a.m.p.b.ProfileSplitterBolt
Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing,
partition=0, offset=5491, kafkaTimestamp=1538129863880
.........
2018-09-28 10:17:45.026 o.a.m.p.b.ProfileSplitterBolt
Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing,
partition=0, offset=5492, kafkaTimestamp=1538129864998
.....
2018-09-28 10:17:45.859 o.a.m.p.b.ProfileSplitterBolt
Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing,
partition=0, offset=5493, kafkaTimestamp=1538129865850
`
> Add Kafka Partition and Offset to Profiler Debug Logs
> -----------------------------------------------------
>
> Key: METRON-1782
> URL: https://issues.apache.org/jira/browse/METRON-1782
> Project: Metron
> Issue Type: Bug
> Reporter: Nick Allen
> Assignee: Nick Allen
> Priority: Major
>
> I was troubleshooting an issue that a user was running into with the
> Profiler. The logs made it appear that a second batch of messages were being
> sent after a period of time, when none actually were.
> We found that the second batch was actually just Storm timing out the first
> batch of messages and re-sending them. This would have been simple to
> uncover if we had the Kafka topic, partition, and offset details of each
> message logged at a DEBUG level.
> I made those code change while debugging the issue. I thought this might be
> generally useful to roll into Apache.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
