The profiler seems to hang when using more than 1 worker thread.... Ah, that is 
now fixed. See discussion with @bpr:

  * 
[https://github.com/pb-cdunn/nim-debug/issues/2](https://github.com/pb-cdunn/nim-debug/issues/2)



Now the problem is a sudden jump in freemem on the main thread, and huge use of 
virtual memory. E.g. 
    
    
    +      log("tot=$1 occ=$2, free=$3 b4" % [$getTotalMem(), 
$getOccupiedMem(), $getFreeMem()])
    +      GC_fullCollect()
    +      log("tot=$1 occ=$2, free=$3 now" % [$getTotalMem(), 
$getOccupiedMem(), $getFreeMem()])
    
    
    
    $ time N=4 SIZE=huge make
    ../main.exe --output_multi --min_idt 0.70 --min_cov 4 --max_n_read 500 
--n_core 4 > out.nim.fasta < data/la4.huge/huge.la4falco
    n
    main(n_core=4)
    len(seqs)=25, seed_id=2
    tot=4206592 occ=3895296, free=311296 b4
    tot=4206592 occ=1511424, free=2695168 now
    len(seqs)=98, seed_id=14
    tot=12738560 occ=5505024, free=7233536 b4
    tot=12738560 occ=5517312, free=7221248 now
    len(seqs)=58, seed_id=15
    tot=8822784 occ=8105984, free=716800 b4
    tot=8822784 occ=5414912, free=3407872 now
    ...
    len(seqs)=37, seed_id=42
    tot=9052160 occ=6340608, free=2711552 b4
    tot=9052160 occ=5013504, free=4038656 now
    len(seqs)=49, seed_id=43
    tot=9052160 occ=6770688, free=2281472 b4
    tot=9052160 occ=6270976, free=2781184 now
    len(seqs)=55, seed_id=53
    tot=2156535808 occ=7073792, free=2149462016 b4  !!!!!!!!!!!
    tot=2156535808 occ=6787072, free=2149748736 now !!!!!!!!!!!
    len(seqs)=50, seed_id=57
    tot=9445376 occ=7110656, free=2334720 b4  ???
    tot=9445376 occ=6815744, free=2629632 now
    len(seqs)=29, seed_id=58
    tot=9445376 occ=7041024, free=2404352 b4
    tot=9445376 occ=6066176, free=3379200 now
    ...
    

See the sudden jump? Something weird is going on. (That is with 
`GC_fullCollect()` bewteen "b4" and "now" on the main thread.)

Virtual memory jumps around, as low at 1TB and as high as 60TB. So think there 
is still a problem, though not as bad as before: no crash, no increase in 
system RAM, decent runtime.

  * 
[https://github.com/pb-cdunn/nim-debug/issues/3](https://github.com/pb-cdunn/nim-debug/issues/3)


Reply via email to