OK, I get

> pfcount_aggregator -i 
> dnacl:1@0+dnacl:1@1+dnacl:1@2+dnacl:1@3+dnacl:1@4+dnacl:1@5+dnacl:1@6+dnacl:1@7+dnacl:1@8+dnacl:1@9+dnacl:1@10+dnacl:1@11+dnacl:1@12+dnacl:1@13+dnacl:1@14+dnacl:1@15

Using PF_RING v.5.4.6
Capturing from dnacl:1@0
# Device RX channels: 1
Capturing from dnacl:1@1
# Device RX channels: 1
 *** error opening /mnt/hugepages/dnacluster_1_248: Too many open files ***
 *** error mmap'ing 385 hugepages of 2 Mb ***
 * Error: failure mapping hugepages

Increasing the hugepages to 2GB makes no difference, and 385x2Mb < 1GB
anyway.

> hugeadm --explain
> Total System Memory: 32130 MB
> 
> Mount Point          Options
> /mnt/hugepages       rw,relatime
> 
> Huge page pools:
>       Size  Minimum  Current  Maximum  Default
>    2097152     1024     1024     1024        *
> 
> Huge page sizes with configured pools:
> 2097152
> 
> The recommended shmmax for your currently allocated huge pages is 2147483648 
> bytes.
> To make shmmax settings persistent, add the following line to 
> /etc/sysctl.conf:
>   kernel.shmmax = 2147483648
> 
> To make your hugetlb_shm_group settings persistent, add the following line to 
> /etc/sysctl.conf:
>   vm.hugetlb_shm_group = 0
> 
> Note: Permanent swap space should be preferred when dynamic huge page pools 
> are used.

By default kernel.shmmax was only 32MB, but increasing it on its own
didn't solve my issue.

Best Wishes,
Chris

On 23/10/12 18:27, Alfredo Cardigliano wrote:
> Chris
> you can dynamically allocate hugepages with:
> 
> echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages
> 
> or you can change the default size and allocate them at boot time with kernel 
> parameters:
> 
> default_hugepagesz=1G hugepagesz=1G hugepages=4
> 
> In order to make the hugepages available for use, before running the cluster, 
> you have to mount the hugetlbfs filesystem somewhere:
> 
> mount -t hugetlbfs none /mnt/hugepages
> 
> After that, you can run the pfdnacluster_master with -u.
> Please let us know.
> 
> Regards
> Alfredo
> 
> On Oct 23, 2012, at 7:09 PM, Chris Wakelin <[email protected]> wrote:
> 
>> I'd not heard of hugepages before. It looks like Ubuntu 12.04 has 2MB
>> pages defined but none allocated. It also supports "transparent huge
>> pages". Can these be used by DNA clusters? Can you give some suggested
>> settings I could try?
>>
>> Best Wishes,
>> Chris
>>
>> On 21/10/12 18:51, Alfredo Cardigliano wrote:
>>> Chris
>>> besides the low-level settings, now you can also use the hugepages support.
>>> Be aware it is a pretty new feature under testing (see pfdnacluster_master 
>>> -u).
>>> Please note that you have to setup the hugepages support in your system 
>>> before using it.
>>> If you decide to have a look at it, please let us know if it is working 
>>> fine for you.
>>>
>>> Best Regards
>>> Alfredo
>>>

-- 
--+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+-
Christopher Wakelin,                           [email protected]
IT Services Centre, The University of Reading,  Tel: +44 (0)118 378 2908
Whiteknights, Reading, RG6 6AF, UK              Fax: +44 (0)118 975 3094
_______________________________________________
Ntop-misc mailing list
[email protected]
http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Reply via email to