Lyndon, Did you commit the new profile?
GB -----Original Message----- From: Lyndon Labuschagne [mailto:lynd...@mobiletorque.co.za] Sent: Sunday, August 7, 2016 7:24 PM To: nfsen-discuss@lists.sourceforge.net Subject: Re: [Nfsen-discuss] Error reading channel stat information. Missing key 'first' OK went one further scraped the VM clean install of Ubuntu 16.04 Running nfsen (1.3.7) and the latest nfdump from github rrdtool 1.5.5 and still the same issue, RRDs are only generated on the live profile any advise would be much appreciated > On 07 Aug 2016, at 13:00, Lyndon Labuschagne <lynd...@mobiletorque.co.za> > wrote: > > Hi All > > I really hope someone can assist > > It seems a few people have run into this issue, and the resolution > seems to be related to either a change in rrdtool (upgrade or > downgrade) or having meaningful expiry information > > I have tried this on Ubuntu 16 and 14, rrdtool 1.5.5 rrdtool 1.5.6 and > now rrdtool 1.4.7 > > This is the error i get > Aug 7 12:55:15 flows nfsen[1868]: Update profile mtdbnc1_kzn in group > Routers Aug 7 12:55:15 flows nfsen[1868]: Error reading channel stat > information. Missing key 'first' > Aug 7 12:55:15 flows nfsen[1868]: message repeated 3 times: [ Error > reading channel stat information. Missing key 'first'] > > the Live profile works fine, I have created a Routers profile and set the > expiry to 5 G / 30 Days. > The Routers profile is Continous Profile individual channels, and a > Real Profile > > > Here is a log extract > > Aug 7 12:55:00 flows nfcapd[1577]: Ident: 'lyndonteracojhb_gp' Flows: > 750, Packets: 52492, Bytes: 72559620, Sequence Errors: 0, Bad Packets: > 0 Aug 7 12:55:00 flows nfcapd[1577]: Ident: 'mtdbnc1_kzn' Flows: > 27930, Packets: 248372, Bytes: 64251361, Sequence Errors: 0, Bad > Packets: 0 Aug 7 12:55:00 flows nfcapd[1577]: Total ignored packets: > 0 Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket Aug 7 > 12:55:15 flows nfsen[2467]: comm server started: 20929 Aug 7 12:55:15 > flows nfsen[20929]: Cmd Decode: signal Aug 7 12:55:15 flows nfsen[20929]: > Cmd Decode: quit Aug 7 12:55:15 flows nfsen[2466]: Signal 'start-periodic' > Aug 7 12:55:15 flows nfsen[2466]: Run periodic at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[2466]: Prepare profiling './live' > Aug 7 12:55:15 flows nfsen[2466]: Prepare profiling 'Routers/mtdbnc1_kzn' > Aug 7 12:55:15 flows nfsen[2466]: 4 channels/alerts to profile Aug 7 > 12:55:15 flows nfsen[2466]: Limit profilers: 4 Aug 7 12:55:15 flows > nfsen[2467]: comm child[20929] terminated with no exit value Aug 7 > 12:55:15 flows nfsen[20932]: profile opts: > Routers#mtdbnc1_kzn#2#www#mtdbnc1_kzn for profiler 1 Aug 7 12:55:15 > flows nfsen[20930]: profile opts: > Routers#mtdbnc1_kzn#2#https#mtdbnc1_kzn for profiler 0 Aug 7 12:55:15 > flows nfsen[20930]: profiler 0 started Aug 7 12:55:15 flows > nfsen[20932]: profiler 1 started Aug 7 12:55:15 flows nfsen[20934]: > profile opts: Routers#mtdbnc1_kzn#2#ftp#mtdbnc1_kzn for profiler 2 Aug > 7 12:55:15 flows nfsen[20934]: profiler 2 started Aug 7 12:55:15 > flows nfsen[20930]: profiler 0 finished Aug 7 12:55:15 flows > nfsen[20932]: profiler 1 finished Aug 7 12:55:15 flows nfsen[20934]: > profiler 2 finished Aug 7 12:55:15 flows nfsen[20936]: profile opts: > Routers#mtdbnc1_kzn#2#dns#mtdbnc1_kzn for profiler 3 Aug 7 12:55:15 > flows nfsen[20936]: profiler 3 started Aug 7 12:55:15 flows nfsen[20936]: > profiler 3 finished Aug 7 12:55:15 flows nfsen[2466]: Update profile live in > group . > Aug 7 12:55:15 flows nfsen[2466]: Add channel size 86016 Aug 7 > 12:55:15 flows nfsen[2466]: Add channel size 1257472 Aug 7 12:55:15 > flows nfsen[2466]: Set new profile size: 1343488 Aug 7 12:55:15 flows > nfsen[2466]: Add .:live:201608071250 for plugin processing Aug 7 > 12:55:15 flows nfsen[2467]: connection on UNIX socket Aug 7 12:55:15 > flows nfsen[2467]: comm server started: 20940 Aug 7 12:55:15 flows > nfsen[20940]: Cmd Decode: signal Aug 7 12:55:15 flows nfsen[20940]: > Cmd Decode: quit Aug 7 12:55:15 flows nfsen[2467]: comm child[20940] > terminated with no exit value Aug 7 12:55:15 flows nfsen[1868]: > Signal 'start-periodic' > Aug 7 12:55:15 flows nfsen[1868]: Run periodic at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[1868]: Prepare profiling './live' > Aug 7 12:55:15 flows nfsen[1868]: Prepare profiling 'Routers/mtdbnc1_kzn' > Aug 7 12:55:15 flows nfsen[1868]: 4 channels/alerts to profile Aug 7 > 12:55:15 flows nfsen[1868]: Limit profilers: 4 Aug 7 12:55:15 flows > nfsen[2467]: connection on UNIX socket Aug 7 12:55:15 flows > nfsen[2467]: comm server started: 20946 Aug 7 12:55:15 flows > nfsen[20946]: Cmd Decode: signal Aug 7 12:55:15 flows nfsen[20946]: > Cmd Decode: quit Aug 7 12:55:15 flows nfsen[2233]: Signal > 'start-periodic' > Aug 7 12:55:15 flows nfsen[2233]: Run periodic at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[20941]: profile opts: > Routers#mtdbnc1_kzn#2#dns#mtdbnc1_kzn for profiler 0 Aug 7 12:55:15 > flows nfsen[20941]: profiler 0 started Aug 7 12:55:15 flows nfsen[2233]: > Prepare profiling './live' > Aug 7 12:55:15 flows nfsen[20945]: profile opts: > Routers#mtdbnc1_kzn#2#ftp#mtdbnc1_kzn for profiler 2 Aug 7 12:55:15 > flows nfsen[20945]: profiler 2 started Aug 7 12:55:15 flows nfsen[2233]: > Prepare profiling 'Routers/mtdbnc1_kzn' > Aug 7 12:55:15 flows nfsen[20941]: profiler 0 finished Aug 7 > 12:55:15 flows nfsen[2233]: 4 channels/alerts to profile Aug 7 > 12:55:15 flows nfsen[2233]: Limit profilers: 4 Aug 7 12:55:15 flows > nfsen[20945]: profiler 2 finished Aug 7 12:55:15 flows nfsen[20948]: > profile opts: Routers#mtdbnc1_kzn#2#www#mtdbnc1_kzn for profiler 3 Aug > 7 12:55:15 flows nfsen[20948]: profiler 3 started Aug 7 12:55:15 > flows nfsen[2467]: comm child[20946] terminated with no exit value Aug > 7 12:55:15 flows nfsen[20943]: nfsend: exit child[20944] Exit: 255, > Signal: 0, Core: 0 Aug 7 12:55:15 flows nfsen[20943]: profile opts: > Routers#mtdbnc1_kzn#2#https#mtdbnc1_kzn for profiler 1 Aug 7 12:55:15 > flows nfsen[20943]: profiler 1 started Aug 7 12:55:15 flows > nfsen[1868]: nfsend: exit child[20943] Exit: 0, Signal: 13, Core: 0 > Aug 7 12:55:15 flows nfsen[20948]: profiler 3 finished Aug 7 > 12:55:15 flows nfsen[20952]: profile opts: > Routers#mtdbnc1_kzn#2#https#mtdbnc1_kzn for profiler 1 Aug 7 12:55:15 > flows nfsen[20955]: profile opts: > Routers#mtdbnc1_kzn#2#www#mtdbnc1_kzn for profiler 3 Aug 7 12:55:15 > flows nfsen[20952]: profiler 1 started Aug 7 12:55:15 flows > nfsen[20950]: profile opts: Routers#mtdbnc1_kzn#2#dns#mtdbnc1_kzn for > profiler 0 Aug 7 12:55:15 flows nfsen[20950]: profiler 0 started Aug > 7 12:55:15 flows nfsen[20955]: nfsend: exit child[20956] Exit: 255, > Signal: 0, Core: 0 Aug 7 12:55:15 flows nfsen[20955]: profiler 3 > started Aug 7 12:55:15 flows nfsen[20953]: profile opts: > Routers#mtdbnc1_kzn#2#ftp#mtdbnc1_kzn for profiler 2 Aug 7 12:55:15 > flows nfsen[20953]: profiler 2 started Aug 7 12:55:15 flows > nfsen[20952]: profiler 1 finished Aug 7 12:55:15 flows nfsen[2233]: nfsend: > exit child[20955] Exit: 0, Signal: 13, Core: 0 Aug 7 12:55:15 flows > nfsen[20950]: profiler 0 finished Aug 7 12:55:15 flows nfsen[1868]: Update > profile mtdbnc1_kzn in group Routers Aug 7 12:55:15 flows nfsen[1868]: Error > reading channel stat information. Missing key 'first' > Aug 7 12:55:15 flows nfsen[1868]: message repeated 3 times: [ Error > reading channel stat information. Missing key 'first'] Aug 7 12:55:15 > flows nfsen[1868]: Set new profile size: 0 Aug 7 12:55:15 flows > nfsen[1868]: Add Routers:mtdbnc1_kzn:201608071250 for plugin > processing Aug 7 12:55:15 flows nfsen[20953]: profiler 2 finished Aug > 7 12:55:15 flows nfsen[2233]: Run plugins for 201608071250 Aug 7 12:55:15 > flows nfsen[2233]: Run plugins done. > Aug 7 12:55:15 flows nfsen[2233]: Check alerts for Sun Aug 7 > 12:50:00 2016 Aug 7 12:55:15 flows nfsen[2233]: Check alerts done. > Aug 7 12:55:15 flows nfsen[2233]: Run expire at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[2233]: End expire at Sun Aug 7 > 12:55:00 2016 Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX > socket Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20958 > Aug 7 12:55:15 flows nfsen[20958]: Cmd Decode: signal Aug 7 12:55:15 > flows nfsen[20958]: Cmd Decode: quit Aug 7 12:55:15 flows > nfsen[20958]: Cleanup Routine Aug 7 12:55:15 flows nfsen[2233]: > Signal 'end-periodic' > Aug 7 12:55:15 flows nfsen[2467]: comm child[20958] terminated with > no exit value Aug 7 12:55:15 flows nfsen[2466]: Run plugins for > 201608071250 Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX > socket Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20959 > Aug 7 12:55:15 flows nfsen[20959]: Cmd Decode: run-plugins Aug 7 > 12:55:15 flows nfsen[20959]: Plugin Cycle: ., live, 201608071250 Aug > 7 12:55:15 flows nfsen[20959]: Cmd Decode: quit Aug 7 12:55:15 flows > nfsen[2466]: Run plugins done. > Aug 7 12:55:15 flows nfsen[2466]: Check alerts for Sun Aug 7 > 12:50:00 2016 Aug 7 12:55:15 flows nfsen[2466]: Check alerts done. > Aug 7 12:55:15 flows nfsen[2466]: Run expire at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[2466]: Expire profile live group . low water > mark: 90%% > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: Expired files: 0 > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: Expired file size: 0 B > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: Expired time range: 0 sec > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: > Aug 7 12:55:15 flows nfsen[2466]: End expire at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket Aug > 7 12:55:15 flows nfsen[2467]: comm server started: 20961 Aug 7 > 12:55:15 flows nfsen[2467]: comm child[20959] terminated with no exit > value Aug 7 12:55:15 flows nfsen[20961]: Cmd Decode: signal Aug 7 > 12:55:15 flows nfsen[20961]: Cmd Decode: quit Aug 7 12:55:15 flows > nfsen[20961]: Cleanup Routine Aug 7 12:55:15 flows nfsen[2466]: > Signal 'end-periodic' > Aug 7 12:55:15 flows nfsen[2467]: comm child[20961] terminated with > no exit value Aug 7 12:55:15 flows nfsen[1868]: Run plugins for > 201608071250 Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX > socket Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20962 > Aug 7 12:55:15 flows nfsen[20962]: Cmd Decode: run-plugins Aug 7 > 12:55:15 flows nfsen[20962]: Plugin Cycle: Routers, mtdbnc1_kzn, > 201608071250 Aug 7 12:55:15 flows nfsen[20962]: Cmd Decode: quit Aug > 7 12:55:15 flows nfsen[1868]: Run plugins done. > Aug 7 12:55:15 flows nfsen[1868]: Check alerts for Sun Aug 7 > 12:50:00 2016 Aug 7 12:55:15 flows nfsen[1868]: Check alerts done. > Aug 7 12:55:15 flows nfsen[1868]: Run expire at Sun Aug 7 12:55:00 > 2016 Aug 7 12:55:15 flows nfsen[1868]: Expire profile live group . > low water mark: 90%% Aug 7 12:55:15 flows nfsen[2467]: comm child[20962] > terminated with no exit value > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired files: 0 > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired file size: 0 B > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired time range: 0 sec > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: > Aug 7 12:55:15 flows nfsen[1868]: Expire profile mtdbnc1_kzn group > Routers low water mark: 90%% Aug 7 12:55:15 flows nfsen[1868]: > nfexpire: Force rebuild requested by stat record in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/dns > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested > by stat record in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/https > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested > by stat record in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/www > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested > by stat record in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/ftp > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/dns .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/https .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/www .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/ftp .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired files: 0 > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired file size: 0 B > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired time range: 0 sec > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: > Aug 7 12:55:15 flows nfsen[1868]: End expire at Sun Aug 7 12:55:00 > 2016 > ---------------------------------------------------------------------- > -------- _______________________________________________ > Nfsen-discuss mailing list > Nfsen-discuss@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nfsen-discuss ------------------------------------------------------------------------------ _______________________________________________ Nfsen-discuss mailing list Nfsen-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfsen-discuss ------------------------------------------------------------------------------ _______________________________________________ Nfsen-discuss mailing list Nfsen-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfsen-discuss
