[
https://bro-tracker.atlassian.net/browse/BIT-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=20424#comment-20424
]
Garanews commented on BIT-1383:
-------------------------------
In the reporter.log I have only warnings like this:
1429884007.525166 Reporter::WARNING Analyzer Files::ANALYZER_X509
not added successfully to file FZMat825gmR7UiqCHg.
/opt/bro/share/bro/base/frameworks/files/./main.bro, line 286
I have enabled the profiling and looks like:
1429882423.269744 Memory: total=*27988K **total_adj=4127060K malloced: 24905K
1429882423.269744 Run-time: user+sys=285.1 user=256.3 sys=28.8 real=1756.6
1429882423.269744 Conns: total=0 current=0/0 ext=0 mem=0K avg=0.0 table=0K
connvals=0K
1429882423.269744 Conns: tcp=0/0 udp=0/0 icmp=0/0
1429882423.269744 TCP-States: Inact. Syn. SA Part. Est.
Fin. Rst.
1429882423.269744 TCP-States:Inact.
1429882423.269744 TCP-States:Syn.
1429882423.269744 TCP-States:SA
1429882423.269744 TCP-States:Part.
1429882423.269744 TCP-States:Est.
1429882423.269744 TCP-States:Fin.
1429882423.269744 TCP-States:Rst.
1429882423.269744 Connections expired due to inactivity: 0
1429882423.269744 Total reassembler data: 0K
1429882423.269744 Timers: current=71 max=72 mem=5K lag=0.00s
1429882423.269744 DNS_Mgr: requests=0 succesful=0 failed=0 pending=0
cached_hosts=0 cached_addrs=0
1429882423.269744 Triggers: total=2 pending=0
1429882423.269744 RotateTimer = 28
1429882423.269744 ScheduleTimer = 15
1429882423.269744 TableValTimer = 28
1429882423.269744 Threads: current=36
After a while:
1429887084.548535 Memory: total=*811348K *total_adj=716116K malloced: 791111K
1429887084.548535 Run-time: user+sys=875.4 user=770.1 sys=105.3 real=6417.9
1429887084.548535 Conns: total=0 current=0/0 ext=0 mem=0K avg=0.0 table=0K
connvals=0K
1429887084.548535 Conns: tcp=0/0 udp=0/0 icmp=0/0
1429887084.548535 TCP-States: Inact. Syn. SA Part. Est.
Fin. Rst.
1429887084.548535 TCP-States:Inact.
1429887084.548535 TCP-States:Syn.
1429887084.548535 TCP-States:SA
1429887084.548535 TCP-States:Part.
1429887084.548535 TCP-States:Est.
1429887084.548535 TCP-States:Fin.
1429887084.548535 TCP-States:Rst.
1429887084.548535 Connections expired due to inactivity: 0
1429887084.548535 Total reassembler data: 0K
1429887084.548535 Timers: current=73 max=74 mem=5K lag=0.00s
1429887084.548535 DNS_Mgr: requests=0 succesful=0 failed=0 pending=0
cached_hosts=0 cached_addrs=0
1429887084.548535 Triggers: total=2 pending=0
1429887084.548535 RotateTimer = 30
1429887084.548535 ScheduleTimer = 15
1429887084.548535 TableValTimer = 28
1429887084.548535 Threads: current=37
So it seems that same threads are leaking ram during time.
But see what happened this morning: the number of threads grown up to 150...
!threads.png!
Seems related to ram leakage:
!screenshot-1.png!
regarding prof.log what do you mean with table are growing large?
I have rows pasted here and others related to single scritps like:
1429887594.568636 software/Log::WRITER_ASCII in=4564 out=197 pending=4296/0
(#queue r/w: in=268/4564 out=197/197)
Thanks
> memory leak
> -----------
>
> Key: BIT-1383
> URL: https://bro-tracker.atlassian.net/browse/BIT-1383
> Project: Bro Issue Tracker
> Issue Type: Problem
> Components: Bro
> Affects Versions: 2.3
> Environment: Ubuntu 12.04.5 LTS
> Reporter: Garanews
> Labels: leak, memory
> Attachments: screenshot-1.png, threads.png
>
>
> BRO is taking almos all resources availables (CPUs and 192GBRAM +50GB Swap) :
> top - 12:26:56 up 1 day, 1:40, 2 users, load average: 28.10, 28.69, 27.94
> Tasks: 365 total, 16 running, 349 sleeping, 0 stopped, 0 zombie
> Cpu(s): 28.7%us, 18.4%sy, 1.4%ni, 48.3%id, 2.4%wa, 0.0%hi, 0.7%si, 0.0%st
> Mem: 198059808k total, 197549384k used, 510424k free, 1384k buffers
> Swap: 201289980k total, 50575440k used, 150714540k free, 10596k cached
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 13551 root 20 0 1341m 880m 517m R 100 0.5 993:31.62 bro
> 13596 root 20 0 1173m 882m 517m R 100 0.5 1001:27 bro
> 13617 root 20 0 8472m 898m 517m R 100 0.5 990:51.10 bro
> 13659 root 20 0 1469m 889m 517m R 100 0.5 990:53.08 bro
> 13679 root 20 0 1390m 885m 517m R 100 0.5 981:09.51 bro
> 13681 root 20 0 2229m 1.8g 517m R 100 1.0 952:03.55 bro
> 13653 root 20 0 2953m 881m 517m R 99 0.5 988:00.31 bro
> 13685 root 20 0 1106m 888m 517m R 99 0.5 988:19.98 bro
> 13641 root 20 0 1122m 884m 517m R 64 0.5 987:33.61 bro
> 13672 root 20 0 10.1g 7.5g 517m R 56 4.0 987:49.47 bro
> 13696 root 20 0 1161m 881m 517m R 53 0.5 982:57.39 bro
> 13668 root 20 0 1149m 883m 517m S 51 0.5 989:52.19 bro
> 13691 root 20 0 1989m 884m 517m R 50 0.5 1012:40 bro
> 13692 root 20 0 1190m 885m 517m S 48 0.5 995:16.83 bro
> 13677 root 20 0 1188m 889m 517m S 44 0.5 993:21.39 bro
> 13687 root 20 0 5340m 2.7g 517m S 43 1.5 978:51.70 bro
> 8906 root 25 5 294m 111m 672 S 40 0.1 526:31.84 bro
> 6545 root 25 5 1235m 859m 624 S 29 0.4 482:23.79 bro
> 4645 root 20 0 198g 160g 1832 S 24 85.0 254:50.36 bro
> 8238 root 20 0 1755m 114m 1716 S 19 0.1 129:58.95 bro
> 15196 root 25 5 685m 539m 515m S 16 0.3 219:22.30 bro
> 15149 root 25 5 678m 535m 515m S 16 0.3 210:17.67 bro
> 15166 root 25 5 678m 544m 515m S 16 0.3 208:54.70 bro
> 15200 root 25 5 686m 543m 515m S 16 0.3 210:56.13 bro
> 15148 root 25 5 678m 546m 515m R 16 0.3 211:22.38 bro
> 15186 root 25 5 685m 537m 515m S 16 0.3 208:55.80 bro
> 15187 root 25 5 685m 545m 515m R 16 0.3 211:02.48 bro
> 15188 root 25 5 685m 536m 515m R 16 0.3 207:31.37 bro
> 15197 root 25 5 692m 536m 515m S 16 0.3 208:34.05 bro
> 15201 root 25 5 692m 547m 515m S 16 0.3 209:19.18 bro
> 15165 root 25 5 685m 543m 515m S 15 0.3 207:28.37 bro
> 15147 root 25 5 692m 536m 515m S 15 0.3 210:45.36 bro
> 15185 root 25 5 686m 544m 515m S 15 0.3 210:45.12 bro
> 15198 root 25 5 678m 546m 515m S 15 0.3 203:51.90 bro
> 15150 root 25 5 678m 537m 515m S 15 0.3 207:34.16 bro
> 15199 root 25 5 685m 537m 515m S 14 0.3 204:45.21 bro
--
This message was sent by Atlassian JIRA
(v6.5-OD-01-120#65000)
_______________________________________________
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev
