Hi Allen, Thanks for the reply by the way. I’ve been checking my profiler, tweaking some options and whatnot. I’ve set the “timestampField” and solved half the issue. I ran the spark batch profiler and it rectified the counts. Then I started the Storm profiler once again. Now the profiler is delayed one hour and a half and counting the same record twice. I’ve restarted it, reinstalled it and it keeps delayed somehow. I even droped the HBase table and created a new one and the Storm profiler is still delayed. I’m sending the records myself, so it’s just 2 to 10 records at a time. And the topology logs in the Storm UI tells it’s actually doing its job. The system time is synchronized and the ASA records are generated in the same timezone. I’m running out of options here.
Thanks