Ben, Now it's working much better, it takes some time to get this error. But unfortunately, it's still there. Seems it heavily depends on system load. It I put Thread.sleep(10) in putting thread it never happens.
| configure(): attribute size: 25 | setClusterConfig(): setting cluster properties from xml to: UDP(ip_mcast=true;ip_ttl=64;loopback=true;mcast_addr=228.1.2.3;mcast_port=45566;mcast_recv_buf_size=80000;mcast_send_buf_size=150000;ucast_recv_buf_size=80000;ucast_send_buf_size=150000):PING(down_thread=false;num_initial_members=3;timeout=2000;up_thread=false):MERGE2(max_interval=20000;min_interval=10000):FD_SOCK:VERIFY_SUSPECT(down_thread=false;timeout=1500;up_thread=false):pbcast.NAKACK(down_thread=false;gc_lag=50;max_xmit_size=8192;retransmit_timeout=600,1200,2400,4800;up_thread=false):UNICAST(down_thread=false;min_threshold=10;timeout=600,1200,2400;window_size=100):pbcast.STABLE(desired_avg_gossip=20000;down_thread=false;up_thread=false):FRAG(down_thread=false;frag_size=8192;up_thread=false):pbcast.GMS(join_retry_timeout=2000;join_timeout=5000;print_local_addr=true;shun=true):pbcast.STATE_TRANSFER(down_thread=true;up_thread=true) | setEvictionPolicyConfig(): [config: null] | interceptor chain is: | class org.jboss.cache.interceptors.CallInterceptor | class org.jboss.cache.interceptors.ReplicationInterceptor | class org.jboss.cache.interceptors.TransactionInterceptor | cache mode is REPL_SYNC | unicast sockets will use interface 192.168.2.3 | socket information: | local_addr=grc03:3519, mcast_addr=228.1.2.3:45566, bind_addr=/192.168.2.3, ttl=64 | sock: bound to 192.168.2.3:3519, receive buffer size=80000, send buffer size=150000 | mcast_recv_sock: bound to 192.168.2.3:45566, send buffer size=150000, receive buffer size=80000 | mcast_send_sock: bound to 192.168.2.3:3520, send buffer size=150000, receive buffer size=80000 | | ------------------------------------------------------- | GMS: address is grc03:3519 | ------------------------------------------------------- | viewAccepted(): new members: [grc03:3519] | state could not be retrieved (must be first member in group) | Starting eviction policy using the provider: org.jboss.cache.eviction.LRUPolicy | new cache is null (maybe first member in cluster) | Starting a eviction timer with wake up interval of (secs) 5 | Nodes: 161 | Nodes: 2951 | Nodes: 12388 | Nodes: 17902 | Nodes: 25040 | Nodes: 28816 | Nodes: 3142 | Nodes: 11843 | Nodes: 20680 | Nodes: 25990 | Nodes: 33636 | Nodes: 4868 | Nodes: 13993 | Nodes: 20029 | Nodes: 28710 | Nodes: 36381 | Nodes: 4335 | Nodes: 13071 | Nodes: 19388 | Nodes: 28335 | Nodes: 35693 | Nodes: 43115 | Nodes: 48385 | Nodes: 5213 | Nodes: 14498 | Nodes: 6281 | Nodes: 15074 | Nodes: 23786 | Nodes: 28775 | Nodes: 37780 | Nodes: 1423 | Nodes: 10301 | Nodes: 19641 | Nodes: 28831 | Nodes: 37106 | Nodes: 28555 | Nodes: 31029 | Nodes: 35806 | Nodes: 38927 | Nodes: 40414 | Nodes: 42059 | Nodes: 47092 | Nodes: 51839 | Nodes: 56676 | Nodes: 57094 | Nodes: 57111 | Nodes: 60808 | Nodes: 64463 | Nodes: 68561 | Nodes: 72609 | Nodes: 75329 | Nodes: 76526 | Nodes: 80795 | Nodes: 85269 | Nodes: 89576 | Nodes: 93573 | Nodes: 94997 | Nodes: 99122 | Nodes: 100316 | Nodes: 101730 | Nodes: 103151 | Nodes: 104694 | Nodes: 105332 | Nodes: 101138 | Nodes: 101183 | Nodes: 101193 | Nodes: 94799 | run(): error processing eviction with exception: org.jboss.cache.eviction.EvictionException: LRUAlgorith.evict(). Node not found with this fqn: /test1/node3774346 will reset the eviction list. | org.jboss.cache.eviction.EvictionException: LRUAlgorith.evict(). Node not found with this fqn: /test1/node3774346 | at org.jboss.cache.eviction.LRUAlgorithm.evict(LRUAlgorithm.java:623) | at org.jboss.cache.eviction.LRUAlgorithm.prune(LRUAlgorithm.java:565) | at org.jboss.cache.eviction.LRUAlgorithm.process(LRUAlgorithm.java:111) | at org.jboss.cache.eviction.EvictionTimerTask.run(EvictionTimerTask.java:69) | at java.util.TimerThread.mainLoop(Timer.java:432) | at java.util.TimerThread.run(Timer.java:382) | run(): error processing eviction with exception: org.jboss.cache.eviction.EvictionException: LRUAlgorith.evict(). Node not found with this fqn: /test1/node3774346 will reset the eviction list. | org.jboss.cache.eviction.EvictionException: LRUAlgorith.evict(). Node not found with this fqn: /test1/node3774346 | at org.jboss.cache.eviction.LRUAlgorithm.evict(LRUAlgorithm.java:623) | at org.jboss.cache.eviction.LRUAlgorithm.prune(LRUAlgorithm.java:565) | at org.jboss.cache.eviction.LRUAlgorithm.process(LRUAlgorithm.java:111) | at org.jboss.cache.eviction.EvictionTimerTask.run(EvictionTimerTask.java:69) | at java.util.TimerThread.mainLoop(Timer.java:432) | at java.util.TimerThread.run(Timer.java:382) | Nodes: 48758 | Nodes: 50600 | Nodes: 58431 | Nodes: 66235 | | Comparing with previous version it'n not 100% reproduced. Since no it's not stopping next eviction calls I can live with it. But there's another problem. Under heavy load eviction doesn't manage to do it work in time. In my case I easily get OutOfMemory exception (following example for policy maxNodes set to just 100) | configure(): attribute size: 25 | setClusterConfig(): setting cluster properties from xml to: UDP(ip_mcast=true;ip_ttl=64;loopback=true;mcast_addr=228.1.2.3;mcast_port=45566;mcast_recv_buf_size=80000;mcast_send_buf_size=150000;ucast_recv_buf_size=80000;ucast_send_buf_size=150000):PING(down_thread=false;num_initial_members=3;timeout=2000;up_thread=false):MERGE2(max_interval=20000;min_interval=10000):FD_SOCK:VERIFY_SUSPECT(down_thread=false;timeout=1500;up_thread=false):pbcast.NAKACK(down_thread=false;gc_lag=50;max_xmit_size=8192;retransmit_timeout=600,1200,2400,4800;up_thread=false):UNICAST(down_thread=false;min_threshold=10;timeout=600,1200,2400;window_size=100):pbcast.STABLE(desired_avg_gossip=20000;down_thread=false;up_thread=false):FRAG(down_thread=false;frag_size=8192;up_thread=false):pbcast.GMS(join_retry_timeout=2000;join_timeout=5000;print_local_addr=true;shun=true):pbcast.STATE_TRANSFER(down_thread=true;up_thread=true) | setEvictionPolicyConfig(): [config: null] | interceptor chain is: | class org.jboss.cache.interceptors.CallInterceptor | class org.jboss.cache.interceptors.ReplicationInterceptor | class org.jboss.cache.interceptors.TransactionInterceptor | cache mode is REPL_SYNC | unicast sockets will use interface 192.168.2.3 | socket information: | local_addr=grc03:4855, mcast_addr=228.1.2.3:45566, bind_addr=/192.168.2.3, ttl=64 | sock: bound to 192.168.2.3:4855, receive buffer size=80000, send buffer size=150000 | mcast_recv_sock: bound to 192.168.2.3:45566, send buffer size=150000, receive buffer size=80000 | mcast_send_sock: bound to 192.168.2.3:4856, send buffer size=150000, receive buffer size=80000 | | ------------------------------------------------------- | GMS: address is grc03:4855 | ------------------------------------------------------- | viewAccepted(): new members: [grc03:4855] | state could not be retrieved (must be first member in group) | Starting eviction policy using the provider: org.jboss.cache.eviction.LRUPolicy | new cache is null (maybe first member in cluster) | Starting a eviction timer with wake up interval of (secs) 5 | Tue Aug 24 11:06:28 CEST 2004 Nodes: 163 | Tue Aug 24 11:06:29 CEST 2004 Nodes: 3070 | Tue Aug 24 11:06:30 CEST 2004 Nodes: 8896 | Tue Aug 24 11:06:31 CEST 2004 Nodes: 14002 | Tue Aug 24 11:06:32 CEST 2004 Nodes: 22968 | Tue Aug 24 11:06:33 CEST 2004 New eviction task started. | Tue Aug 24 11:06:33 CEST 2004 Nodes: 27600 | Tue Aug 24 11:06:34 CEST 2004 Nodes: 33372 | Tue Aug 24 11:06:35 CEST 2004 Eviction task finished. | Tue Aug 24 11:06:35 CEST 2004 Nodes: 169 | Tue Aug 24 11:06:36 CEST 2004 Nodes: 8495 | Tue Aug 24 11:06:37 CEST 2004 Nodes: 15999 | Tue Aug 24 11:06:38 CEST 2004 New eviction task started. | Tue Aug 24 11:06:38 CEST 2004 Nodes: 22538 | Tue Aug 24 11:06:39 CEST 2004 Nodes: 29884 | Tue Aug 24 11:06:40 CEST 2004 Nodes: 37066 | Tue Aug 24 11:06:41 CEST 2004 Nodes: 44396 | Tue Aug 24 11:06:42 CEST 2004 Nodes: 50692 | Tue Aug 24 11:06:43 CEST 2004 Nodes: 53754 | Tue Aug 24 11:06:44 CEST 2004 Nodes: 58896 | Tue Aug 24 11:06:45 CEST 2004 Nodes: 66052 | Tue Aug 24 11:06:46 CEST 2004 Nodes: 72438 | Tue Aug 24 11:06:47 CEST 2004 Nodes: 74223 | Tue Aug 24 11:06:48 CEST 2004 Nodes: 80446 | Tue Aug 24 11:06:49 CEST 2004 Nodes: 87711 | Tue Aug 24 11:06:51 CEST 2004 Nodes: 89614 | Tue Aug 24 11:06:52 CEST 2004 Nodes: 96986 | Tue Aug 24 11:06:54 CEST 2004 Nodes: 99668 | Tue Aug 24 11:06:55 CEST 2004 Nodes: 101496 | Tue Aug 24 11:06:57 CEST 2004 Nodes: 105142 | Tue Aug 24 11:06:58 CEST 2004 Nodes: 106932 | Tue Aug 24 11:07:00 CEST 2004 Nodes: 108747 | Tue Aug 24 11:07:02 CEST 2004 Nodes: 110573 | Tue Aug 24 11:07:03 CEST 2004 Nodes: 112388 | Tue Aug 24 11:07:05 CEST 2004 Nodes: 114023 | Tue Aug 24 11:07:06 CEST 2004 Nodes: 115293 | Tue Aug 24 11:07:08 CEST 2004 Nodes: 116271 | Tue Aug 24 11:07:09 CEST 2004 Nodes: 117051 | Tue Aug 24 11:07:11 CEST 2004 Nodes: 117644 | Tue Aug 24 11:07:12 CEST 2004 Nodes: 118095 | Tue Aug 24 11:07:14 CEST 2004 Nodes: 118431 | Tue Aug 24 11:07:15 CEST 2004 Nodes: 118713 | Tue Aug 24 11:07:17 CEST 2004 Nodes: 118935 | | java.lang.OutOfMemoryError | | org.jboss.util.NestedRuntimeException: - nested throwable: (java.lang.OutOfMemoryError) | at org.jboss.cache.TreeCache.invokeMethod(TreeCache.java:3176) | at org.jboss.cache.TreeCache.put(TreeCache.java:1742) | at org.jboss.cache.TreeCache.put(TreeCache.java:1725) | at test.com.dukascopy.mt.data.TestCache$1.run(TestCache.java:63) | Caused by: java.lang.OutOfMemoryError | org.jboss.util.NestedRuntimeException: - nested throwable: (java.lang.OutOfMemoryError) | at org.jboss.cache.TreeCache.invokeMethod(TreeCache. | | As you see eviction task started but for a minute didn't manage to do any noticeable garbage collecting. I thing it production environment it's very possible case. Don't you thing you should advance eviction thread priority so it's always cleaning faster then garbage appear? View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=3845986#3845986 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=3845986 ------------------------------------------------------- SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33 Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift. http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285 _______________________________________________ JBoss-Development mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/jboss-development
