[389-users] db2index Not Stopping

2014-05-30 Thread Fong, Trevor
Hi Everyone,

Searches and any kind of access to a particular ou seem to be hanging (yep, 
even tried deleting it and it's children) so I ran db2index and left it running 
all night.  It's still running 20 hours later - is that normal?  If it's not, 
is it OK to kill the process?  What would you recommend?

Here's the kind of output I'm getting:

[30/May/2014:07:46:27 -0700] - WARNING: Import is running with 
nsslapd-db-private-import-mem on; No other process is allowed to access the 
database
[30/May/2014:07:46:27 -0700] - reindex userRoot: Sweep done.
[30/May/2014:07:46:27 -0700] - reindex userRoot: Beginning pass number 210
[30/May/2014:07:46:47 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 214714423.4/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:47:07 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 107357211.7/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:47:27 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 71571474.5/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:47:47 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 53678605.9/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:48:08 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 42942884.7/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:48:28 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 35489987.3/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:48:48 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 30455946.6/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:49:08 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 26672599.2/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:49:28 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 23725350.7/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:49:48 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 21364619.2/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:50:08 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 19431169.5/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:50:28 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 17818624.4/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:50:48 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 16453212.5/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:51:08 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 15282165.4/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:51:28 -0700] - reindex userRoot: Processed 678827 entries (pass 
210) -- average rate 14266739.1/sec, recent rate 0.0/sec, hit ratio 0%
[30/May/2014:07:51:28 -0700] - reindex userRoot: Decided to end this pass 
because the progress rate has dropped below the 50% threshold.
[30/May/2014:07:51:28 -0700] - reindex userRoot: Ending pass number 210 ...
[30/May/2014:07:51:28 -0700] - reindex userRoot: Foreman is done; waiting for 
workers to finish...
[30/May/2014:07:51:28 -0700] - reindex userRoot: Workers finished; cleaning 
up...
[30/May/2014:07:51:28 -0700] - reindex userRoot: Workers cleaned up.
[30/May/2014:07:51:28 -0700] - reindex userRoot: Sweeping files for merging 
later...

We're running 389-ds-base.x86_64 1.2.11.29-1.el6

Thanks a lot,
Trev

-
Trevor Fong - Senior Programmer Analyst
Identity and Access Management Group
University of British Columbia - Information Technology
6356 Agricultural Road, Vancouver, BC, V6T 1Z2, Canada
Ph: (604) 827-5247


--
389 users mailing list
389-users@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/389-users

Re: [389-users] db2index Not Stopping

2014-05-30 Thread Noriko Hosoi

Unfortunately, you have to kill the process ns-slapd, which is hanging.

Could you tell us the command line you ran for reindexing?

If you rerun the command line with -d 524288, does the output get more 
verbose and give you any clue?


If it's not informative, to investigate further, could you run this 
command and see what attribute value is causing this hang?
# dbscan -f 
/var/lib/dirsrv/slapd-YOUR_SERVER_ID/db/YOUR_BACKEND/id2entry.db -K 678827
# dbscan -f 
/var/lib/dirsrv/slapd-YOUR_SERVER_ID/db/YOUR_BACKEND/id2entry.db -K 678828


If the attribute value to be reindexed is huge, increasing the entry 
cache size might help.

Edit /etc/dirsrv/slapd-YOUR_SERVER_ID/dse.ldif
dn: cn=YOUR_BACKEND,cn=ldbm database,cn=plugins,cn=config
nsslapd-cachememsize: ## -- set large size (but has to be less than 
the physical memory size)


--noriko

Fong, Trevor wrote:


Hi Everyone,

Searches and any kind of access to a particular ou seem to be hanging 
(yep, even tried deleting it and it’s children) so I ran db2index and 
left it running all night.  It’s still running 20 hours later – is 
that normal?  If it’s not, is it OK to kill the process?  What would 
you recommend?


Here’s the kind of output I’m getting:

[30/May/2014:07:46:27 -0700] - WARNING: Import is running with 
nsslapd-db-private-import-mem on; No other process is allowed to 
access the database


[30/May/2014:07:46:27 -0700] - reindex userRoot: Sweep done.

[30/May/2014:07:46:27 -0700] - reindex userRoot: Beginning pass number 210

[30/May/2014:07:46:47 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 214714423.4/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:47:07 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 107357211.7/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:47:27 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 71571474.5/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:47:47 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 53678605.9/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:48:08 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 42942884.7/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:48:28 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 35489987.3/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:48:48 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 30455946.6/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:49:08 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 26672599.2/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:49:28 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 23725350.7/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:49:48 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 21364619.2/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:50:08 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 19431169.5/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:50:28 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 17818624.4/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:50:48 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 16453212.5/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:51:08 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 15282165.4/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:51:28 -0700] - reindex userRoot: Processed 678827 
entries (pass 210) -- average rate 14266739.1/sec, recent rate 
0.0/sec, hit ratio 0%


[30/May/2014:07:51:28 -0700] - reindex userRoot: Decided to end this 
pass because the progress rate has dropped below the 50% threshold.


[30/May/2014:07:51:28 -0700] - reindex userRoot: Ending pass number 
210 ...


[30/May/2014:07:51:28 -0700] - reindex userRoot: Foreman is done; 
waiting for workers to finish...


[30/May/2014:07:51:28 -0700] - reindex userRoot: Workers finished; 
cleaning up...


[30/May/2014:07:51:28 -0700] - reindex userRoot: Workers cleaned up.

[30/May/2014:07:51:28 -0700] - reindex userRoot: Sweeping files for 
merging later...


We’re running 389-ds-base.x86_64 1.2.11.29-1.el6

Thanks a lot,

Trev

-
Trevor Fong – Senior Programmer Analyst

Identity and Access Management Group
University of British Columbia – Information Technology
6356 Agricultural Road, Vancouver, BC, V6T 1Z2, Canada
Ph: (604) 827-5247



--
389 users mailing list
389-users@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/389-users


--
389 users mailing list
389-users@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/389-users