Emanuele
Here is the information, I can monitor the memory usage with zabbix
and a custom template
(https://github.com/thecamels/zabbix/blob/master/templates/Template%20Specific%20Process%20Memory%20Usage.xml)
If you want to do tests, please contact me off the list and I can
give you ssh access.
==32365== by 0x9339341: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93394E5: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E0B4: g_type_register_fundamental (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93230CB: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318645: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365==
==32365== 130 bytes in 1 blocks are possibly lost in loss record 253
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x933A129: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93185E2: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365== by 0xFFF000925: ???
==32365==
==32365== 132 bytes in 1 blocks are possibly lost in loss record 254
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339FBF: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x931E5BB: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318636: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 132 bytes in 1 blocks are possibly lost in loss record 255
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339FBF: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x931E621: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318636: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 148 bytes in 1 blocks are possibly lost in loss record 257
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339D93: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9328034: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318640: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 148 bytes in 1 blocks are possibly lost in loss record 258
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339D93: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93230CB: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318645: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 155 (48 direct, 107 indirect) bytes in 1 blocks are
definitely lost in loss record 259 of 302
==32365== at 0x4C29180: operator new(unsigned long)
(vg_replace_malloc.c:324)
==32365== by 0x4A2B7D: Ntop::registerNagios() (Ntop.cpp:281)
==32365== by 0x482E17: main (main.cpp:128)
==32365==
==32365== 160 bytes in 1 blocks are possibly lost in loss record 260
of 302
==32365== at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365== by 0x5A51CD9: my_malloc (in
/usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A4D059: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A1FEED: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A0DD0B: mysql_server_init (in
/usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A147B6: mysql_init (in
/usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x497C54: MySQLDB::connectToDB(st_mysql*, bool)
(MySQLDB.cpp:685)
==32365== by 0x497001: MySQLDB::MySQLDB(NetworkInterface*)
(MySQLDB.cpp:479)
==32365== by 0x4BEFD3:
BatchedMySQLDB::BatchedMySQLDB(NetworkInterface*)
(BatchedMySQLDB.cpp:26)
==32365== by 0x44CB51: NetworkInterface::NetworkInterface(char
const*, char const*) (NetworkInterface.cpp:167)
==32365== by 0x49C848: ParserInterface::ParserInterface(char
const*, char const*) (ParserInterface.cpp:27)
==32365== by 0x4B84EC: CollectorInterface::CollectorInterface(char
const*) (CollectorInterface.cpp:26)
==32365==
==32365== 184 bytes in 1 blocks are possibly lost in loss record 263
of 302
==32365== at 0x4C2AF2E: realloc (vg_replace_malloc.c:692)
==32365== by 0x95AF88D: g_realloc (in
/lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x93392E9: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E2CC: g_type_register_static (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9329BD9: g_param_type_register_static (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x932B838: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x931864A: ??? (in
/usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365==
==32365== 200 bytes in 1 blocks are definitely lost in loss record
266 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x5A5368E: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A0DCF4: mysql_server_init (in
/usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A147B6: mysql_init (in
/usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x497C54: MySQLDB::connectToDB(st_mysql*, bool)
(MySQLDB.cpp:685)
==32365== by 0x4BF694: BatchedMySQLDB::queryLoop()
(BatchedMySQLDB.cpp:244)
==32365== by 0x494EA8: queryLoop(void*) (MySQLDB.cpp:27)
==32365== by 0x5F9A063: start_thread (pthread_create.c:309)
==32365== by 0x845062C: clone (clone.S:111)
==32365==
==32365== 255 bytes in 6 blocks are definitely lost in loss record
268 of 302
==32365== at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365== by 0x48A548: Prefs::setOption(int, char*) (Prefs.cpp:541)
==32365== by 0x48CF2E: Prefs::loadFromFile(char const*)
(Prefs.cpp:1192)
==32365== by 0x482D66: main (main.cpp:109)
==32365==
==32365== 256 bytes in 1 blocks are possibly lost in loss record 271
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x55E4C0: array_list_new (arraylist.c:36)
==32365== by 0x55B76C: json_object_new_array (json_object.c:849)
==32365== by 0x430021: Flow::flow2json() (Flow.cpp:1901)
==32365== by 0x42F2D0: Flow::serialize(bool) (Flow.cpp:1738)
==32365== by 0x44F1EA: NetworkInterface::dumpDBFlow(long, Flow*)
(NetworkInterface.cpp:711)
==32365== by 0x42B2B0: Flow::dumpFlow(bool) (Flow.cpp:873)
==32365== by 0x42C814: Flow::update_hosts_stats(timeval*)
(Flow.cpp:1176)
==32365== by 0x455293: flow_update_hosts_stats(GenericHashEntry*,
void*) (NetworkInterface.cpp:2371)
==32365== by 0x416DF4: GenericHash::walk(bool
(*)(GenericHashEntry*, void*), void*) (GenericHash.cpp:155)
==32365== by 0x4553ED: NetworkInterface::periodicStatsUpdate()
(NetworkInterface.cpp:2434)
==32365== by 0x45BDE1: NetworkInterface::runHousekeepingTasks()
(NetworkInterface.cpp:4443)
==32365==
==32365== 336 bytes in 1 blocks are possibly lost in loss record 273
of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x40111C1: allocate_dtv (dl-tls.c:296)
==32365== by 0x40118CD: _dl_allocate_tls (dl-tls.c:460)
==32365== by 0x5F9ABE7: allocate_stack (allocatestack.c:589)
==32365== by 0x5F9ABE7: pthread_create@@GLIBC_2.2.5
(pthread_create.c:495)
==32365== by 0x4970EC: MySQLDB::startDBLoop() (MySQLDB.cpp:491)
==32365== by 0x4A7784: NetworkInterface::startDBLoop() (in
/usr/bin/ntopng)
==32365== by 0x4A6E99: Ntop::registerInterface(NetworkInterface*)
(Ntop.cpp:1566)
==32365== by 0x4831CD: main (main.cpp:227)
==32365==
==32365== 2,515 (40 direct, 2,475 indirect) bytes in 1 blocks are
definitely lost in loss record 294 of 302
==32365== at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365== by 0x4E450A5: ??? (in
/usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4E455AE: ??? (in
/usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4E434C6: ??? (in
/usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4E43852: pcap_findalldevs (in
/usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4AF289: Utils::getInterfaceDescription(char*,
char*, int) (Utils.cpp:2212)
==32365== by 0x44C47C: NetworkInterface::NetworkInterface(char
const*, char const*) (NetworkInterface.cpp:103)
==32365== by 0x49C848: ParserInterface::ParserInterface(char
const*, char const*) (ParserInterface.cpp:27)
==32365== by 0x4B84EC: CollectorInterface::CollectorInterface(char
const*) (CollectorInterface.cpp:26)
==32365== by 0x482FDD: main (main.cpp:165)
==32365==
==32365== 14,528 (3,024 direct, 11,504 indirect) bytes in 42 blocks
are definitely lost in loss record 298 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x55AAD1: json_object_new (json_object.c:186)
==32365== by 0x55B74A: json_object_new_array (json_object.c:845)
==32365== by 0x430021: Flow::flow2json() (Flow.cpp:1901)
==32365== by 0x42F2D0: Flow::serialize(bool) (Flow.cpp:1738)
==32365== by 0x44F1EA: NetworkInterface::dumpDBFlow(long, Flow*)
(NetworkInterface.cpp:711)
==32365== by 0x42B2B0: Flow::dumpFlow(bool) (Flow.cpp:873)
==32365== by 0x42C814: Flow::update_hosts_stats(timeval*)
(Flow.cpp:1176)
==32365== by 0x455293: flow_update_hosts_stats(GenericHashEntry*,
void*) (NetworkInterface.cpp:2371)
==32365== by 0x416DF4: GenericHash::walk(bool
(*)(GenericHashEntry*, void*), void*) (GenericHash.cpp:155)
==32365== by 0x4553ED: NetworkInterface::periodicStatsUpdate()
(NetworkInterface.cpp:2434)
==32365== by 0x45BDE1: NetworkInterface::runHousekeepingTasks()
(NetworkInterface.cpp:4443)
==32365==
==32365== LEAK SUMMARY:
==32365== definitely lost: 3,672 bytes in 55 blocks
==32365== indirectly lost: 14,086 bytes in 188 blocks
==32365== possibly lost: 5,549 bytes in 88 blocks
==32365== still reachable: 224,012 bytes in 827 blocks
==32365== suppressed: 0 bytes in 0 blocks
==32365== Reachable blocks (those to which a pointer was found) are
not shown.
==32365== To see them, rerun with: --leak-check=full
--show-leak-kinds=all
==32365==
==32365== For counts of detected and suppressed errors, rerun with: -v
==32365== Use --track-origins=yes to see where uninitialised values
come from
==32365== ERROR SUMMARY: 415821 errors from 124 contexts (suppressed:
0 from 0)
==32365== could not unlink
/tmp/vgdb-pipe-from-vgdb-to-32365-by-root-on-???
==32365== could not unlink
/tmp/vgdb-pipe-to-vgdb-from-32365-by-root-on-???
==32365== could not unlink
/tmp/vgdb-pipe-shared-mem-vgdb-32365-by-root-on-???
Regards
Roberto
Sobre 24-08-2017 15:38:37, Emanuele Faranda <[email protected]>
escribió:
_______________________________________________ Ntop mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop
Hi Roberto,
Can you monitor the ntopng memory usage over some hours to see if
that is the process which consumes memory?
I've just committed a fix for a memory leak on the Mac.cpp but it
cannot affect you since you are receiving flows from nProbe. It will
be very helpful if you could run ntopng with valgrind and send me
the valgrind log (just the last 200 lines of log or so). Please
execute
sudo valgrind --leak-check=full ntopng /etc/ntopng.conf
Regards,
Emanuele
On Thu, Aug 24, 2017 at 6:40 PM, Roberto Alvarado
<[email protected]> wrote:
Hi,
The problem is after some time, here is the log from the start of
ntopng to the die of the process:
23/Aug/2017 11:20:05 [Ntop.cpp:1437] Setting local networks to
[REMOVED]
23/Aug/2017 11:20:05 [Redis.cpp:109] Successfully connected to
redis 127.0.0.1:6379@0
23/Aug/2017 11:20:05 [NtopPro.cpp:183] [LICENSE] Reading license
from /etc/ntopng.license
23/Aug/2017 11:20:05 [NtopPro.cpp:118] [LICENSE]
/etc/ntopng.license: unable to validate Enterprise license [License
mismatch error]
23/Aug/2017 11:20:05 [NtopPro.cpp:121] [LICENSE]
/etc/ntopng.license: found valid Professional license
23/Aug/2017 11:20:06 [MySQLDB.cpp:680] Attempting to connect to
MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:720] Successfully connected to
MySQL [localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 11:20:06 [Ntop.cpp:1563] Registered interface
tcp://127.0.0.1:5556 [id: 0]
23/Aug/2017 11:20:06 [main.cpp:252] PID stored in file
/var/tmp/ntopng.pid
23/Aug/2017 11:20:06 [HTTPserver.cpp:797] Please read
https://github.com/ntop/ntopng/blob/dev/doc/README.SSL if you want
to enable SSL.
23/Aug/2017 11:20:06 [Utils.cpp:427] User changed to nobody
23/Aug/2017 11:20:06 [HTTPserver.cpp:851] Web server dirs
[/usr/share/ntopng/httpdocs][/usr/share/ntopng/scripts]
23/Aug/2017 11:20:06 [HTTPserver.cpp:854] HTTP server listening on
port(s) 3000
23/Aug/2017 11:20:06 [MySQLDB.cpp:667] Disconnected from MySQL for
interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:680] Attempting to connect to
MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:720] Successfully connected to
MySQL [localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 11:20:06 [main.cpp:320] Working directory: /data/ntopng
23/Aug/2017 11:20:06 [main.cpp:322] Scripts/HTML pages directory:
/usr/share/ntopng
23/Aug/2017 11:20:06 [Ntop.cpp:340] Welcome to ntopng x86_64
v.3.1.170821 - (C) 1998-17 ntop.org
23/Aug/2017 11:20:06 [Ntop.cpp:345] Built on Debian GNU/Linux 8.2
(jessie)
23/Aug/2017 11:20:06 [NtopPro.cpp:383] [LICENSE] System Id:
[REMOVED]
23/Aug/2017 11:20:06 [NtopPro.cpp:384] [LICENSE] Edition:
Professional
23/Aug/2017 11:20:06 [NtopPro.cpp:385] [LICENSE] License Type:
Permanent License
23/Aug/2017 11:20:06 [NtopPro.cpp:388] [LICENSE] License:
[REMOVED]
23/Aug/2017 11:20:06 [NtopPro.cpp:398] [LICENSE] Maintenance:
Until Thu Mar 22 12:28:01 2018 [211 days left]
23/Aug/2017 11:20:06 [PeriodicActivities.cpp:50] Started periodic
activities loop...
23/Aug/2017 11:20:06 [NetworkInterface.cpp:2241] Started packet
polling on interface tcp://127.0.0.1:5556 [id: 0]...
23/Aug/2017 11:20:07 [MySQLDB.cpp:680] Attempting to connect to
MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:07 [CollectorInterface.cpp:116] Collecting flows
on tcp://127.0.0.1:5556
23/Aug/2017 11:20:08 [NetworkInterface.cpp:1202] WARNING: A flow
has been seen from multiple exprters or from multiple IN/OUT
interfaces. Check exporters configuration.
23/Aug/2017 12:07:26 [MySQLDB.cpp:720] Successfully connected to
MySQL [localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 17:57:02 [Lua.cpp:6214] WARNING: Script failure
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
23/Aug/2017 17:58:01 [Lua.cpp:6214] WARNING: Script failure
[/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
My config file:
root@mhost:/var/log/ntopng# cat /etc/ntopng/ntopng.conf
-G=/var/tmp/ntopng.pid
-i="tcp://127.0.0.1:5556"
-d="/data/ntopng"
-w="3000"
#-v=5
--max-num-hosts=300000
--local-networks=[REMOVED]
--dump-flows="mysql;localhost;ntop;[REMOVED]"
root@mhost:/var/log/ntopng#
A screenshoot of my dashboard:
https://i.dmtinc.cl/i/2017/08/24/CapturaNTOPNG428fd.png
More info from syslog:
Aug 22 22:20:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory]
Aug 22 22:21:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory]
Aug 22 22:22:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory]
Aug 22 22:23:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory]
Aug 22 22:24:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory]
Aug 22 22:24:09 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:10 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not
enough memory]
Aug 22 22:24:10 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:11 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:12 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:13 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not
enough memory]
Aug 22 22:24:13 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:14 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:15 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:16 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not
enough memory]
Aug 22 22:24:16 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:17 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:18 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
Aug 22 22:24:19 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not
enough memory]
Aug 22 22:24:19 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
not enough memory]
Aug 22 22:24:20 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
not enough memory]
Aug 22 22:24:21 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
not enough memory]
Aug 22 22:24:22 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
not enough memory]
Aug 22 22:24:22 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
not enough memory]
Aug 22 22:24:23 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186:
not enough memory]
Aug 22 22:24:24 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 22 22:24:25 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 22 22:24:25 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 22 22:24:26 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 22 22:24:27 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 22 22:24:28 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 22 22:24:28 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/second.lua][error
loading module 'lua_utils' from file
'/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not
enough memory]
Aug 23 11:20:02 mhost logger: ntopng stop
Aug 23 11:20:05 mhost logger: ntopng start
Aug 23 11:20:08 mhost ntopng: [NetworkInterface.cpp:1202] WARNING:
A flow has been seen from multiple exprters or from multiple IN/OUT
interfaces. Check exporters configuration.
Aug 23 17:57:02 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory]
Aug 23 17:58:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script
failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough
memory
Additional preferences:
{
"ntopng.prefs.housekeeping_frequency": 5,
"ntopng.prefs.local_host_cache_duration": 3600,
"ntopng.prefs.local_host_max_idle": 300,
"ntopng.prefs.non_local_host_max_idle": 60,
"ntopng.prefs.flow_max_idle": 60,
"ntopng.prefs.active_local_host_cache_interval": 3600,
"ntopng.prefs.intf_rrd_raw_days": 1,
"ntopng.prefs.intf_rrd_1min_days": 30,
"ntopng.prefs.intf_rrd_1h_days": 100,
"ntopng.prefs.intf_rrd_1d_days": 365,
"ntopng.prefs.other_rrd_raw_days": 1,
"ntopng.prefs.other_rrd_1min_days": 30,
"ntopng.prefs.other_rrd_1h_days": 100,
"ntopng.prefs.other_rrd_1d_days": 365,
"ntopng.prefs.host_top_sites_creation": false,
"ntopng.prefs.is_local_host_cache_enabled": true,
"ntopng.prefs.is_active_local_host_cache_enabled": true,
"ntopng.prefs.tiny_flows_export_enabled": true,
"ntopng.prefs.max_num_alerts_per_entity": 1024,
"ntopng.prefs.max_num_flow_alerts": 16384,
"ntopng.prefs.flow_device_port_rrd_creation": false,
"ntopng.prefs.disable_alerts_generation": true,
"ntopng.prefs.probing_alerts": false,
"ntopng.prefs.ssl_alerts": false,
"ntopng.prefs.alerts_syslog": true,
"ntopng.prefs.alerts.slack_notifications_enabled": false,
"ntopng.prefs.alerts.dump_alerts_when_iface_is_alerted": false,
"ntopng.prefs.max_num_packets_per_tiny_flow": 3,
"ntopng.prefs.max_num_bytes_per_tiny_flow": 64,
"ntopng.prefs.safe_search_dns": 2078163920,
"ntopng.prefs.global_dns": 4294967295,
"ntopng.prefs.secondary_dns": 4294967295,
"ntopng.prefs.enable_captive_portal": false,
"ntopng.prefs.redirection_url": "http:\/\/www.ntop.org",
"ntopng.prefs.max_ui_strlen": 24,
"ntopng.prefs.host_mask": 0,
"ntopng.prefs.ldap.bind_dn": "",
"ntopng.prefs.ldap.bind_pwd": "",
"ntopng.prefs.ldap.search_path": "",
"ntopng.prefs.ldap.user_group": "",
"ntopng.prefs.ldap.admin_group": "",
"ntopng.prefs.alerts.mysql_check_open_files_limit": "1",
"ntopng.prefs.nagios_nsca_host": "localhost",
"ntopng.prefs.nagios_nsca_port": "5667",
"ntopng.prefs.nagios_send_nsca_executable":
"\/usr\/local\/nagios\/bin\/send_nsca",
"ntopng.prefs.nagios_send_nsca_config":
"\/usr\/local\/nagios\/etc\/send_nsca.cfg",
"ntopng.prefs.nagios_host_name": "ntopng-host",
"ntopng.prefs.nagios_service_name": "NtopngAlert",
"ntopng.prefs.default_snmp_community": "public",
"ntopng.prefs.google_apis_browser_key": "",
"ntopng.prefs.show_advanced_prefs": "true",
"ntopng.prefs.host_blacklist": "0"
}
Regards!
Roberto
Sobre 23-08-2017 4:14:34, Emanuele Faranda <[email protected]>
escribió:
_______________________________________________ Ntop mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop
Hi Roberto,
What is the content of your ntopng.conf file? Does the problem
occur immediately or after some time? Can you post a screenshot of
your ntopng dashboard?
Emanuele
On Wed, Aug 23, 2017 at 1:46 AM, Roberto Alvarado
<[email protected]> wrote:
Hi Folks,
My ntopng is crashing every time when the housekeeping is
executed, the message of the log is explicit “no enough
memory”, but this problems comes out after upgrade my install
to the latest devel version, do you have any clue about this, of
how much memory is needed?
21/Aug/2017 20:14:22 [Lua.cpp:6214] WARNING: Script failure
[/usr/share/ntopng/scripts/callbacks/second.lua][not enough
memory]
21/Aug/2017 20:14:22 [Lua.cpp:6214] WARNING: Script failure
[/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough
memory]
root@mhost:/var/log/ntopng# free -m
total used free shared buffers
cached
Mem: 32163 30833 1329 428 575
25141
-/+ buffers/cache: 5116 27046
Swap: 18530 399 18131
root@mhost:/var/log/ntopng#
root@mhost:/var/log/ntopng# ps aux --sort -rss
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME
COMMAND
nobody 26971 28.1 5.8 3375504 1942968 ? Sl 16:12 76:01
ntopng /etc/ntopng/ntopng.conf
mysql 19755 15.0 1.7 1809120 588236 ? Ssl Aug17 1173:54
/usr/sbin/mysqld
root 838 0.0 0.1 90724 51236 ? Ss Feb17 14:29
/lib/systemd/systemd-journald
root@mhost:/var/log/ntopng# ntopng -V
v.3.1.170821 [Enterprise/Professional build]
GIT rev:
dev:d13a4a219d885e47a46b008c61fb5e24b49b4514:20170821
Pro rev: r1130
Built on: Debian GNU/Linux 8.2 (jessie)
System Id:
Edition: Professional
License Type: Permanent
Maintenance: Until Thu Mar 22 12:28:01 2018 [211 days left]
License:
root@mhost:/var/log/ntopng#
Thanks
Regards
Roberto
_______________________________________________
Ntop mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop
