[freenet-dev] Parameter mistuning / Transport level thrashing

Sat, 15 Mar 2003 13:05:43 -0800

I was looking at my connection time stats last night:

http://localhost:8888/servlet/nodestatus/diagnostics/connectingTime/day

The mean values for the last two days are 11000 and 15000.

This is bad news, since the default routeConnectTime is set to 10000.

If I understand the connection management code correctly, this means that most real (i.e. non cached) outbound connection attempts will fail with a timeout. The fact that the connection will eventually succeed and will be cached doesn't help because the request state machine is already banging on another node reference which will also fail...

wash. rinse. repeat.

It's hard to figure out whether this is a cause or a side effect of the
current massive CPU overuse problem. It definitely isn't helping network congestion any.

Are most people seeing connection times this high?

--gj

p.s.:
Load average: 15
System PII 233, 192M of RAM
env page with system info attached.







Title: Environment


    

        

            Freenet logo
            
                

                    
 
                        
                        
                        
                    


                    

                         
                        Freenet
                        
                    


                    

                        
                        
                        
                    


                    

                        
                        
                        
                    

  
                    

                        
                        Environment
                        
                    


                    
 
                        
                        
                        
                    

                

            		
            
        

    

    

        

            

  
 
    
    
    
  


  

   
   Node Information
   
  


  

    
    
    
  


  

    
    
    
  

  
  

   
   Web Interface


Performance


  • General Information
    
Networking
    

  • Open Connections
    

  • Distribution Node
    

  • Network Load
    
Internals
    

  • Node Status Interface
    

  • Recent logs
    

  • Pending Tasks
    

  • Failure Table
    

  • Environment
    

  • Command Line Info
    

    • 
    		
   
  
    

  
     
    
    
    
  
    

    
    		
            
    
  
     
    
    
    
  
    

  
    
   
   Architecture and Operating System
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    Architecturei386
    

    Available processors1
    

    Operating SystemLinux
    

    OS Version2.4.18-26.8.0
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    
  
     
    
    
    
  
    

  
    
   
   Java Virtual Machine
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    JVM VendorSun Microsystems Inc.
    

    JVM NameJava HotSpot(TM) Client VM
    

    JVM Version1.4.1_02-b06
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    
  
     
    
    
    
  
    

  
    
   
   Memory Allocation
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    Maximum memory the JVM will allocate128 MiB
    

    Memory currently allocated by the JVM65,088 KiB
    

    Memory in use51,659,688 Bytes
    

    Unused allocated memory14,988,976 Bytes
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    
  
     
    
    
    
  
    

  
    
   
   Data Store
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    Total size of the data store512 MiB
    

    Space used by temp files in the data store31,456 KiB
    

    Maximum space for temp files in the data store178,956,976 Bytes
    

    Free space in the data store1,020 KiB
    

    Used space in the data store523,268 KiB
    

    Most recent file timestampSat Mar 15 21:54:20 EST 2003
    

    Least recent file timestampFri Mar 14 06:24:27 EST 2003
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    
  
     
    
    
    
  
    

  
    
   
   Transports
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    Current IPv4 address66.31.44.189
    

    Current IPv4 port2333
    

    ARK sequence number2
    

    Last ARK sequence number inserted2
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    
  
     
    
    
    
  
    

  
    
   
   Thread Pool
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    Total pooled threads160
    

    Available pooled threads35
    

    Pooled threads in use125
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    
  
     
    
    
    
  
    

  
    
   
   Pooled Thread Consumers
   
  
    

  
    
    
    
    
  
    

  
    
    
    
    
  
    
  
  
    
   
   
    

    ClassThreads used

    freenet.interfaces.LocalInterface$ConnectionShell1
    

    freenet.node.states.data.DataStateInitiator1
    

    freenet.interfaces.PublicInterface$ConnectionShell47
    

    Checkpoint: Fetching ARK freenet:SSK3
    

    freenet.OpenConnectionManager$ConnectionJob43
    

    freenet.Message: QueryRestarted 1
    

    freenet.Message: DataRequest 12
    

    freenet.Message: InsertRequest 1
    

    freenet.node.states.request.RequestInitiator4
    

    freenet.Message: QueryRejected 12
    

    
    		
   
  
    

  
     
    
    
    
  
    

    

    


    
ThreadGroup/Thread Hierarchy:

      

    • system
        

      • Reference Handler

      • Finalizer

      • CompileThread0

      • main
          

        • main

        • Diffie-Helman-Precalc

        • Thread-2

        • Thread creation thread.

        • Polling thread for single Reaper instance.

        • Freenet Node: 90ef00ade2d57bb0d32d087152ee0a51b7f50202
            

          • Ticker

          • Interface # tcp/2333

          • Interface # tcp/8481

          • Interface # tcp/8888

          • Interface # tcp/8891

          • QThread-1133: [EMAIL PROTECTED]

          • QThread-1870: [EMAIL PROTECTED]

          • QThread-2159: [EMAIL PROTECTED]

          • QThread-9444: [EMAIL PROTECTED]

          • QThread-17426: [EMAIL PROTECTED] @ 1047723985957

          • QThread-17445: [EMAIL PROTECTED]

          • QThread-20034: [EMAIL PROTECTED]

          • QThread-22227: [EMAIL PROTECTED]

          • QThread-28113: [EMAIL PROTECTED]

          • QThread-28194: [EMAIL PROTECTED]

          • QThread-28386: [EMAIL PROTECTED]

          • QThread-28413: [EMAIL PROTECTED]

          • QThread-28416: [EMAIL PROTECTED]

          • QThread-28508: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 7af907cba402fa8f @ 1047783323599

          • QThread-28551: [EMAIL PROTECTED]

          • QThread-28553: [EMAIL PROTECTED]

          • QThread-28555: freenet.Message: DataRequest @[EMAIL PROTECTED] @ e534633cd9e2b894 @ 1047783324023

          • QThread-28620: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 3736fac7a3e12d3f @ 1047783336548

          • QThread-28631: [EMAIL PROTECTED]

          • QThread-28632: [EMAIL PROTECTED]

          • QThread-28638: [EMAIL PROTECTED]

          • QThread-28648: [EMAIL PROTECTED]

          • QThread-28700: [EMAIL PROTECTED]

          • QThread-28738

          • QThread-28743: [EMAIL PROTECTED]

          • QThread-28748: [EMAIL PROTECTED]

          • QThread-28774: [EMAIL PROTECTED]

          • QThread-28781: [EMAIL PROTECTED]

          • QThread-28783: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ 694c65ef41cef145 @ 1047783324273

          • QThread-28786: [EMAIL PROTECTED]

          • QThread-28788: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 2e0ab201ed4ae2d9 @ 1047783323590

          • QThread-28794: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ ee922661487d0986 @ 1047783321146

          • QThread-28795: [EMAIL PROTECTED]

          • QThread-28796

          • QThread-28801: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ 75eed700efee79b0 @ 1047783332126

          • QThread-28804: [EMAIL PROTECTED]

          • QThread-28805: [EMAIL PROTECTED]

          • QThread-28807: Checkpoint: Fetching ARK
freenet:[EMAIL PROTECTED],a3otc2SfVHW1l4~i974QQN2LNHLbsT2c5SLcEablfTk/3
@ 1047782923984 
          • QThread-28810: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ 7ba4aca56b352ff9 @ 1047783324692

          • QThread-28814: [EMAIL PROTECTED]

          • QThread-28822: [EMAIL PROTECTED] @ 1047783326634

          • QThread-28823: [EMAIL PROTECTED]

          • QThread-28829: [EMAIL PROTECTED]

          • QThread-28830: [EMAIL PROTECTED]

          • QThread-28835: [EMAIL PROTECTED]

          • QThread-28836: [EMAIL PROTECTED]

          • QThread-28837: [EMAIL PROTECTED]

          • QThread-28839: [EMAIL PROTECTED]

          • QThread-28840: [EMAIL PROTECTED]

          • QThread-28842

          • QThread-28847: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 3ed5c14c08f96041 @ 1047783323863

          • QThread-28848: [EMAIL PROTECTED] @ 1047783342276

          • QThread-28870: [EMAIL PROTECTED]

          • QThread-28871: [EMAIL PROTECTED]

          • QThread-28873

          • QThread-28874

          • QThread-28875

          • QThread-28876

          • QThread-28877

          • QThread-28878

          • QThread-28879

          • QThread-28880

          • QThread-28881

          • QThread-28882

          • QThread-28883

          • QThread-28884: [EMAIL PROTECTED]

          • QThread-28887: [EMAIL PROTECTED]

          • QThread-28888: freenet.Message: InsertRequest @[EMAIL PROTECTED] @ d18fbe567acd09ce @ 1047783323626

          • QThread-28890: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 8f993300d315c498 @ 1047783336548

          • QThread-28891

          • QThread-28892: [EMAIL PROTECTED]

          • QThread-28893: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ c861252152a4a252 @ 1047783324584

          • QThread-28895: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 71474a10d89d13c9 @ 1047783333888

          • QThread-28896: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 3c9809308d6e45b3 @ 1047783323725

          • QThread-28904: Checkpoint: Fetching ARK
freenet:[EMAIL PROTECTED],y9Uhzvo982ig1ZpfW9GxyxeFWfQWgYm4QHlCE0mP5mc/1
@ 1047783248390 
          • QThread-28905: [EMAIL PROTECTED]

          • QThread-28906: [EMAIL PROTECTED]

          • QThread-28912: [EMAIL PROTECTED]

          • QThread-28913: [EMAIL PROTECTED] @ 1047783325033

          • QThread-28917: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ a46dde0e2376563b @ 1047783324581

          • QThread-28918

          • QThread-28919: [EMAIL PROTECTED]

          • QThread-28920

          • QThread-28921: [EMAIL PROTECTED]

          • QThread-28924: [EMAIL PROTECTED]

          • QThread-28926: [EMAIL PROTECTED]

          • QThread-28928: [EMAIL PROTECTED]

          • QThread-28932

          • QThread-28934: [EMAIL PROTECTED]

          • QThread-28936: freenet.Message: QueryRestarted @[EMAIL PROTECTED] @ fa26591b0ce4fd2e @ 1047783324424

          • QThread-28937: [EMAIL PROTECTED]

          • QThread-28938: [EMAIL PROTECTED]

          • QThread-28939: [EMAIL PROTECTED]

          • QThread-28940: freenet.Message: DataRequest @[EMAIL PROTECTED] @ faeb25bade9bec8c @ 1047783323554

          • QThread-28941: [EMAIL PROTECTED]

          • QThread-28943: [EMAIL PROTECTED]

          • QThread-28963: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ bd7cbdd77f52873e @ 1047783323376

          • QThread-28964: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ f5568533f83f1996 @ 1047783325750

          • QThread-28965: [EMAIL PROTECTED]

          • QThread-28966: [EMAIL PROTECTED]

          • QThread-28967: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 6b297df20d248e86 @ 1047783324145

          • QThread-28968: [EMAIL PROTECTED]

          • QThread-28969: [EMAIL PROTECTED]

          • QThread-28970: [EMAIL PROTECTED]

          • QThread-28971: [EMAIL PROTECTED]

          • QThread-28972: [EMAIL PROTECTED]

          • QThread-28973: [EMAIL PROTECTED]

          • QThread-28974: [EMAIL PROTECTED]

          • QThread-28975: [EMAIL PROTECTED]

          • QThread-28976: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ e7bc3cee36050a21 @ 1047783324012

          • QThread-28977

          • QThread-28978: [EMAIL PROTECTED]

          • QThread-28979: [EMAIL PROTECTED]

          • QThread-28980

          • QThread-28981: [EMAIL PROTECTED]

          • QThread-28982: [EMAIL PROTECTED]

          • QThread-28983: freenet.Message: DataRequest @[EMAIL PROTECTED] @ aa3139eb82b03f68 @ 1047783324011

          • QThread-28984: [EMAIL PROTECTED]

          • QThread-28985: Checkpoint: Fetching ARK
freenet:[EMAIL PROTECTED],~wdSsERfLkHpFvtUEHa3qZJw~MwtQlU7st0bJkGW4RY/1
@ 1047783237860 
          • QThread-28986: [EMAIL PROTECTED]

          • QThread-28987: [EMAIL PROTECTED]

          • QThread-28997: [EMAIL PROTECTED]

          • QThread-28998: [EMAIL PROTECTED]

          • QThread-28999: [EMAIL PROTECTED]

          • QThread-29000: [EMAIL PROTECTED]

          • QThread-29002: [EMAIL PROTECTED]

          • QThread-29003

          • QThread-29004

          • QThread-29005

          • QThread-29006

          • QThread-29007

          • QThread-29008

          • QThread-29009

          • QThread-29010

          • QThread-29011

          • QThread-29012

          • QThread-29013

          • QThread-29014

          • QThread-29015: [EMAIL PROTECTED]

          • QThread-29016: [EMAIL PROTECTED] @ 1047783342009

          • QThread-29017: [EMAIL PROTECTED]

          • QThread-29018

          • QThread-29019: [EMAIL PROTECTED]

          • QThread-29020: [EMAIL PROTECTED]

          • QThread-29021: [EMAIL PROTECTED]

          • QThread-29022: [EMAIL PROTECTED]

          • QThread-29023

          • QThread-29024: freenet.Message: DataRequest @[EMAIL PROTECTED] @ 2fe3378818e8208 @ 1047783337609

          • QThread-29025: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ 2d07efb04819a907 @ 1047783320907

          • QThread-29026: [EMAIL PROTECTED]

          • QThread-29027

          • QThread-29028: [EMAIL PROTECTED]

          • QThread-29029: [EMAIL PROTECTED]

          • QThread-29030: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ 760f906d9e32eb59 @ 1047783323827

          • QThread-29031: freenet.Message: QueryRejected @[EMAIL PROTECTED] @ b4cc7ee9de41bb52 @ 1047783323454

          • QThread-29032: [EMAIL PROTECTED]

          • QThread-29033: [EMAIL PROTECTED]

          • QThread-29034: [EMAIL PROTECTED]

          • QThread-29035: [EMAIL PROTECTED]

          • QThread-29036: [EMAIL PROTECTED]

    Reply via email to