OK went one further scraped the VM clean install of Ubuntu 16.04 Running nfsen (1.3.7) and the latest nfdump from github
rrdtool 1.5.5 and still the same issue, RRDs are only generated on the live profile any advise would be much appreciated > On 07 Aug 2016, at 13:00, Lyndon Labuschagne <lynd...@mobiletorque.co.za> > wrote: > > Hi All > > I really hope someone can assist > > It seems a few people have run into this issue, and the resolution seems to > be related to either a change in rrdtool (upgrade or downgrade) or having > meaningful expiry information > > I have tried this on Ubuntu 16 and 14, rrdtool 1.5.5 rrdtool 1.5.6 and now > rrdtool 1.4.7 > > This is the error i get > Aug 7 12:55:15 flows nfsen[1868]: Update profile mtdbnc1_kzn in group Routers > Aug 7 12:55:15 flows nfsen[1868]: Error reading channel stat information. > Missing key 'first' > Aug 7 12:55:15 flows nfsen[1868]: message repeated 3 times: [ Error reading > channel stat information. Missing key 'first'] > > the Live profile works fine, I have created a Routers profile and set the > expiry to 5 G / 30 Days. > The Routers profile is Continous Profile individual channels, and a Real > Profile > > > Here is a log extract > > Aug 7 12:55:00 flows nfcapd[1577]: Ident: 'lyndonteracojhb_gp' Flows: 750, > Packets: 52492, Bytes: 72559620, Sequence Errors: 0, Bad Packets: 0 > Aug 7 12:55:00 flows nfcapd[1577]: Ident: 'mtdbnc1_kzn' Flows: 27930, > Packets: 248372, Bytes: 64251361, Sequence Errors: 0, Bad Packets: 0 > Aug 7 12:55:00 flows nfcapd[1577]: Total ignored packets: 0 > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20929 > Aug 7 12:55:15 flows nfsen[20929]: Cmd Decode: signal > Aug 7 12:55:15 flows nfsen[20929]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[2466]: Signal 'start-periodic' > Aug 7 12:55:15 flows nfsen[2466]: Run periodic at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[2466]: Prepare profiling './live' > Aug 7 12:55:15 flows nfsen[2466]: Prepare profiling 'Routers/mtdbnc1_kzn' > Aug 7 12:55:15 flows nfsen[2466]: 4 channels/alerts to profile > Aug 7 12:55:15 flows nfsen[2466]: Limit profilers: 4 > Aug 7 12:55:15 flows nfsen[2467]: comm child[20929] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[20932]: profile opts: > Routers#mtdbnc1_kzn#2#www#mtdbnc1_kzn for profiler 1 > Aug 7 12:55:15 flows nfsen[20930]: profile opts: > Routers#mtdbnc1_kzn#2#https#mtdbnc1_kzn for profiler 0 > Aug 7 12:55:15 flows nfsen[20930]: profiler 0 started > Aug 7 12:55:15 flows nfsen[20932]: profiler 1 started > Aug 7 12:55:15 flows nfsen[20934]: profile opts: > Routers#mtdbnc1_kzn#2#ftp#mtdbnc1_kzn for profiler 2 > Aug 7 12:55:15 flows nfsen[20934]: profiler 2 started > Aug 7 12:55:15 flows nfsen[20930]: profiler 0 finished > Aug 7 12:55:15 flows nfsen[20932]: profiler 1 finished > Aug 7 12:55:15 flows nfsen[20934]: profiler 2 finished > Aug 7 12:55:15 flows nfsen[20936]: profile opts: > Routers#mtdbnc1_kzn#2#dns#mtdbnc1_kzn for profiler 3 > Aug 7 12:55:15 flows nfsen[20936]: profiler 3 started > Aug 7 12:55:15 flows nfsen[20936]: profiler 3 finished > Aug 7 12:55:15 flows nfsen[2466]: Update profile live in group . > Aug 7 12:55:15 flows nfsen[2466]: Add channel size 86016 > Aug 7 12:55:15 flows nfsen[2466]: Add channel size 1257472 > Aug 7 12:55:15 flows nfsen[2466]: Set new profile size: 1343488 > Aug 7 12:55:15 flows nfsen[2466]: Add .:live:201608071250 for plugin > processing > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20940 > Aug 7 12:55:15 flows nfsen[20940]: Cmd Decode: signal > Aug 7 12:55:15 flows nfsen[20940]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[2467]: comm child[20940] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[1868]: Signal 'start-periodic' > Aug 7 12:55:15 flows nfsen[1868]: Run periodic at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[1868]: Prepare profiling './live' > Aug 7 12:55:15 flows nfsen[1868]: Prepare profiling 'Routers/mtdbnc1_kzn' > Aug 7 12:55:15 flows nfsen[1868]: 4 channels/alerts to profile > Aug 7 12:55:15 flows nfsen[1868]: Limit profilers: 4 > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20946 > Aug 7 12:55:15 flows nfsen[20946]: Cmd Decode: signal > Aug 7 12:55:15 flows nfsen[20946]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[2233]: Signal 'start-periodic' > Aug 7 12:55:15 flows nfsen[2233]: Run periodic at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[20941]: profile opts: > Routers#mtdbnc1_kzn#2#dns#mtdbnc1_kzn for profiler 0 > Aug 7 12:55:15 flows nfsen[20941]: profiler 0 started > Aug 7 12:55:15 flows nfsen[2233]: Prepare profiling './live' > Aug 7 12:55:15 flows nfsen[20945]: profile opts: > Routers#mtdbnc1_kzn#2#ftp#mtdbnc1_kzn for profiler 2 > Aug 7 12:55:15 flows nfsen[20945]: profiler 2 started > Aug 7 12:55:15 flows nfsen[2233]: Prepare profiling 'Routers/mtdbnc1_kzn' > Aug 7 12:55:15 flows nfsen[20941]: profiler 0 finished > Aug 7 12:55:15 flows nfsen[2233]: 4 channels/alerts to profile > Aug 7 12:55:15 flows nfsen[2233]: Limit profilers: 4 > Aug 7 12:55:15 flows nfsen[20945]: profiler 2 finished > Aug 7 12:55:15 flows nfsen[20948]: profile opts: > Routers#mtdbnc1_kzn#2#www#mtdbnc1_kzn for profiler 3 > Aug 7 12:55:15 flows nfsen[20948]: profiler 3 started > Aug 7 12:55:15 flows nfsen[2467]: comm child[20946] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[20943]: nfsend: exit child[20944] Exit: 255, > Signal: 0, Core: 0 > Aug 7 12:55:15 flows nfsen[20943]: profile opts: > Routers#mtdbnc1_kzn#2#https#mtdbnc1_kzn for profiler 1 > Aug 7 12:55:15 flows nfsen[20943]: profiler 1 started > Aug 7 12:55:15 flows nfsen[1868]: nfsend: exit child[20943] Exit: 0, Signal: > 13, Core: 0 > Aug 7 12:55:15 flows nfsen[20948]: profiler 3 finished > Aug 7 12:55:15 flows nfsen[20952]: profile opts: > Routers#mtdbnc1_kzn#2#https#mtdbnc1_kzn for profiler 1 > Aug 7 12:55:15 flows nfsen[20955]: profile opts: > Routers#mtdbnc1_kzn#2#www#mtdbnc1_kzn for profiler 3 > Aug 7 12:55:15 flows nfsen[20952]: profiler 1 started > Aug 7 12:55:15 flows nfsen[20950]: profile opts: > Routers#mtdbnc1_kzn#2#dns#mtdbnc1_kzn for profiler 0 > Aug 7 12:55:15 flows nfsen[20950]: profiler 0 started > Aug 7 12:55:15 flows nfsen[20955]: nfsend: exit child[20956] Exit: 255, > Signal: 0, Core: 0 > Aug 7 12:55:15 flows nfsen[20955]: profiler 3 started > Aug 7 12:55:15 flows nfsen[20953]: profile opts: > Routers#mtdbnc1_kzn#2#ftp#mtdbnc1_kzn for profiler 2 > Aug 7 12:55:15 flows nfsen[20953]: profiler 2 started > Aug 7 12:55:15 flows nfsen[20952]: profiler 1 finished > Aug 7 12:55:15 flows nfsen[2233]: nfsend: exit child[20955] Exit: 0, Signal: > 13, Core: 0 > Aug 7 12:55:15 flows nfsen[20950]: profiler 0 finished > Aug 7 12:55:15 flows nfsen[1868]: Update profile mtdbnc1_kzn in group Routers > Aug 7 12:55:15 flows nfsen[1868]: Error reading channel stat information. > Missing key 'first' > Aug 7 12:55:15 flows nfsen[1868]: message repeated 3 times: [ Error reading > channel stat information. Missing key 'first'] > Aug 7 12:55:15 flows nfsen[1868]: Set new profile size: 0 > Aug 7 12:55:15 flows nfsen[1868]: Add Routers:mtdbnc1_kzn:201608071250 for > plugin processing > Aug 7 12:55:15 flows nfsen[20953]: profiler 2 finished > Aug 7 12:55:15 flows nfsen[2233]: Run plugins for 201608071250 > Aug 7 12:55:15 flows nfsen[2233]: Run plugins done. > Aug 7 12:55:15 flows nfsen[2233]: Check alerts for Sun Aug 7 12:50:00 2016 > Aug 7 12:55:15 flows nfsen[2233]: Check alerts done. > Aug 7 12:55:15 flows nfsen[2233]: Run expire at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[2233]: End expire at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20958 > Aug 7 12:55:15 flows nfsen[20958]: Cmd Decode: signal > Aug 7 12:55:15 flows nfsen[20958]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[20958]: Cleanup Routine > Aug 7 12:55:15 flows nfsen[2233]: Signal 'end-periodic' > Aug 7 12:55:15 flows nfsen[2467]: comm child[20958] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[2466]: Run plugins for 201608071250 > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20959 > Aug 7 12:55:15 flows nfsen[20959]: Cmd Decode: run-plugins > Aug 7 12:55:15 flows nfsen[20959]: Plugin Cycle: ., live, 201608071250 > Aug 7 12:55:15 flows nfsen[20959]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[2466]: Run plugins done. > Aug 7 12:55:15 flows nfsen[2466]: Check alerts for Sun Aug 7 12:50:00 2016 > Aug 7 12:55:15 flows nfsen[2466]: Check alerts done. > Aug 7 12:55:15 flows nfsen[2466]: Run expire at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[2466]: Expire profile live group . low water > mark: 90%% > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: Expired files: 0 > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: Expired file size: 0 B > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: Expired time range: 0 sec > Aug 7 12:55:15 flows nfsen[2466]: nfexpire: > Aug 7 12:55:15 flows nfsen[2466]: End expire at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20961 > Aug 7 12:55:15 flows nfsen[2467]: comm child[20959] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[20961]: Cmd Decode: signal > Aug 7 12:55:15 flows nfsen[20961]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[20961]: Cleanup Routine > Aug 7 12:55:15 flows nfsen[2466]: Signal 'end-periodic' > Aug 7 12:55:15 flows nfsen[2467]: comm child[20961] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[1868]: Run plugins for 201608071250 > Aug 7 12:55:15 flows nfsen[2467]: connection on UNIX socket > Aug 7 12:55:15 flows nfsen[2467]: comm server started: 20962 > Aug 7 12:55:15 flows nfsen[20962]: Cmd Decode: run-plugins > Aug 7 12:55:15 flows nfsen[20962]: Plugin Cycle: Routers, mtdbnc1_kzn, > 201608071250 > Aug 7 12:55:15 flows nfsen[20962]: Cmd Decode: quit > Aug 7 12:55:15 flows nfsen[1868]: Run plugins done. > Aug 7 12:55:15 flows nfsen[1868]: Check alerts for Sun Aug 7 12:50:00 2016 > Aug 7 12:55:15 flows nfsen[1868]: Check alerts done. > Aug 7 12:55:15 flows nfsen[1868]: Run expire at Sun Aug 7 12:55:00 2016 > Aug 7 12:55:15 flows nfsen[1868]: Expire profile live group . low water > mark: 90%% > Aug 7 12:55:15 flows nfsen[2467]: comm child[20962] terminated with no exit > value > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired files: 0 > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired file size: 0 B > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired time range: 0 sec > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: > Aug 7 12:55:15 flows nfsen[1868]: Expire profile mtdbnc1_kzn group Routers > low water mark: 90%% > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested by stat > record in /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/dns > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested by stat > record in /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/https > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested by stat > record in /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/www > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Force rebuild requested by stat > record in /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/ftp > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/dns .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/https .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/www .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Scanning files in > /data/netflow-data/profiles-data/Routers/mtdbnc1_kzn/ftp .. done. > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired files: 0 > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired file size: 0 B > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: Expired time range: 0 sec > Aug 7 12:55:15 flows nfsen[1868]: nfexpire: > Aug 7 12:55:15 flows nfsen[1868]: End expire at Sun Aug 7 12:55:00 2016 > ------------------------------------------------------------------------------ > _______________________________________________ > Nfsen-discuss mailing list > Nfsen-discuss@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nfsen-discuss ------------------------------------------------------------------------------ _______________________________________________ Nfsen-discuss mailing list Nfsen-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfsen-discuss
