Re: Witango-Talk: new flurry of crashes

Fri, 02 Sep 2005 11:04:02 -0700
How did you trace it to one file? We've been trying to find any pattern in the crashes, and have so far been completely baffled. 


On Sep 2, 2005, at 10:32 AM, Roland A. Dumas wrote:


I've traced the crashes to one .taf and one _function of that taf.

That's the good news. The bad news is that in that function, there  
are three SELECT (search actions) that are fairly simple and  
unchanged in about a year. All of a sudden, it will crash once in a  
while - not every use and no pattern on the search args or the  
found records. Baffling. Turned up logging, but a crash leaves a  
hole in the log.





Hi Roland,

We're seeing the same sort of crashing -- anywhere from 2-6 times per
day. It definitely seems to be traffic related since we saw more like
once a week crashes (still unreliable in my opinion) over the summer
when our students and faculty are out of classes. As soon as they
arrived back on campus, out traffic spiked, and now we're seeing the
regular crashing.  We've cronned a bunch of restarts during the day,
which as least limit the downtime a bit, but it's a hack of a job at
best.

Here are some excerpts from our crash logs (And this is just for this
morning!):


Host Name:      neko.admin.reed.edu
Date/Time:      2005-09-02 01:10:35 -0700
OS Version:     10.3.9 (Build 7W98)
Report Version: 2

Command: witangod
Path:    /Applications/WitangoServer/5.5/witangod
Version: ??? (???)
PID:     14324
Thread:  16

Exception:  EXC_BAD_ACCESS (0x0001)
Codes:      KERN_INVALID_ADDRESS (0x0001) at 0x028fefff


Thread 16 Crashed:
0   witangod            0x000d70f8 0x1000 + 0xd60f8
1   witangod            0x0009d510 0x1000 + 0x9c510
2   witangod            0x000d7ec8 0x1000 + 0xd6ec8
3   witangod            0x000d9b08 0x1000 + 0xd8b08
4   witangod            0x001b8a74 0x1000 + 0x1b7a74
5   witangod            0x00061c40 0x1000 + 0x60c40
6   witangod            0x000622a4 0x1000 + 0x612a4
7   witangod            0x0005fe3c 0x1000 + 0x5ee3c
8   witangod            0x00062d8c 0x1000 + 0x61d8c
9   witangod            0x000565d4 0x1000 + 0x555d4
10  libSystem.B.dylib   0x90024910 _pthread_body + 0x28


Host Name:      neko.admin.reed.edu
Date/Time:      2005-09-02 09:11:54 -0700
OS Version:     10.3.9 (Build 7W98)
Report Version: 2

Command: witangod
Path:    /Applications/WitangoServer/5.5/witangod
Version: ??? (???)
PID:     17235
Thread:  10

Exception:  EXC_BAD_ACCESS (0x0001)
Codes:      KERN_INVALID_ADDRESS (0x0001) at 0xfffffff8

Thread 10 Crashed:
0   libclntsh.dylib     0x0fdf02c0 kghalf + 0x238
1   libclntsh.dylib     0x0fb86508 kpumgs + 0x8c
2   libclntsh.dylib     0x0fb499b8 kpugdcx + 0x88
3   libclntsh.dylib     0x0fb8d79c upidfps + 0x1b0
4   libclntsh.dylib     0x0fb8cfcc upidfn + 0x118
5   libclntsh.dylib     0x0fbf0528 ocidfn + 0x110
6   witangod            0x0009dfd8 0x1000 + 0x9cfd8
7   witangod            0x0009d470 0x1000 + 0x9c470
8   witangod            0x000d6d74 0x1000 + 0xd5d74
9   witangod            0x001b8a18 0x1000 + 0x1b7a18
10  witangod            0x00061b28 0x1000 + 0x60b28
11  witangod            0x000622a4 0x1000 + 0x612a4
12  witangod            0x0005fe3c 0x1000 + 0x5ee3c
13  witangod            0x00062d8c 0x1000 + 0x61d8c
14  witangod            0x000565d4 0x1000 + 0x555d4
15  libSystem.B.dylib   0x90024910 _pthread_body + 0x28



--------------------------------------------------------------------
Shannon Henderson
Web Support Services
Reed College
Portland, OR 97202-8199
503.517.7745
[EMAIL PROTECTED]
--------------------------------------------------------------------


On Aug 23, 2005, at 9:01 AM, Roland Dumas wrote:



I experienced ODBC-related witango crashes on MacOS 10.2.8 until we
upgraded to 10.3.9  Then they went away.

without any changes in software, hardware... we're starting to see
2-3 crashes of witango a day. Not the same animal. The crash log
shows a memory thing, but I can't decipher where the problem might
be. Can anyone look at this crash log and decipher some clues?

(witango 5)


Host Name:      www.ridgewine.com
Date/Time:      2005-08-23 08:54:57 -0700
OS Version:     10.3.9 (Build 7W98)
Report Version: 2

Command: witangod
Path:    /applications/witango/server/witangod
Version: ??? (???)
PID:     18477
Thread:  13

Exception:  EXC_BAD_ACCESS (0x0001)
Codes:      KERN_INVALID_ADDRESS (0x0001) at 0x02514fff

Thread 0:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x001532a8 0x1000 + 0x1522a8
3   witangod              0x0014e8a8 0x1000 + 0x14d8a8
4   witangod              0x00003860 0x1000 + 0x2860
5   witangod              0x000023f4 0x1000 + 0x13f4
6   witangod              0x00002274 0x1000 + 0x1274

Thread 1:
0   libSystem.B.dylib     0x9000b42c select + 0xc
1   witangod              0x00149fac 0x1000 + 0x148fac
2   witangod              0x0000b180 0x1000 + 0xa180
3   witangod              0x0000b084 0x1000 + 0xa084
4   witangod              0x0014e7d8 0x1000 + 0x14d7d8
5   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 2:
0   libSystem.B.dylib     0x90007878 mach_msg_trap + 0x8
1   libSystem.B.dylib     0x900073f8 mach_msg + 0x38
2   libjvm.dylib          0x970001dc JNI_CreateJavaVM_Impl + 0x44ec
3   libjvm.dylib          0x97000170 JNI_CreateJavaVM_Impl + 0x4480
4   libjvm.dylib          0x970f290c JVM_UnloadLibrary + 0xb0fec
5   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 3:
0   libSystem.B.dylib     0x90007878 mach_msg_trap + 0x8
1   libSystem.B.dylib     0x900073f8 mach_msg + 0x38

2   libjvm.dylib          0x96f28448 JVM_GetClassAccessFlags +  
0x11e8

3   libjvm.dylib          0x96f5b0a4 __divdi3 + 0x5094

4   libjvm.dylib          0x96f70ca0 JVM_GetMethodIxModifiers +  
0x4f0
5   libjvm.dylib          0x9701848c JVM_GetInterfaceVersion +  
0x17a4c

6   libjvm.dylib          0x970f290c JVM_UnloadLibrary + 0xb0fec
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 4:
0   libSystem.B.dylib     0x90007878 mach_msg_trap + 0x8
1   libSystem.B.dylib     0x900073f8 mach_msg + 0x38

2   libjvm.dylib          0x96f283c8 JVM_GetClassAccessFlags +  
0x1168

3   libjvm.dylib          0x96f22d28 _mh_dylib_header + 0x2d28
4   libjvm.dylib          0x96f2c194 __cmpdi2 + 0x1ad4
5   libjvm.dylib          0x96f288a8 JVM_MonitorWait + 0x108
6   <<00000000>>     0x03f33580 0 + 0x3f33580
7   <<00000000>>     0x03f2cfb0 0 + 0x3f2cfb0
8   <<00000000>>     0x03f2cfb0 0 + 0x3f2cfb0
9   <<00000000>>     0x03f2a16c 0 + 0x3f2a16c
10  libjvm.dylib          0x96f3aff8 JVM_GetCPMethodClassNameUTF +
0xb38
11  libjvm.dylib          0x96f5c448 JVM_GetCPClassNameUTF + 0x998
12  libjvm.dylib          0x96f990a8 JVM_Close + 0x4b8
13  libjvm.dylib          0x96fa9970 JVM_Interrupt + 0x2e0
14  libjvm.dylib          0x9704e70c JVM_UnloadLibrary + 0xcdec
15  libjvm.dylib          0x96f94e04 JVM_FindClassFromClass + 0xc14
16  libjvm.dylib          0x970f290c JVM_UnloadLibrary + 0xb0fec
17  libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 5:
0   libSystem.B.dylib     0x90007878 mach_msg_trap + 0x8
1   libSystem.B.dylib     0x900073f8 mach_msg + 0x38

2   libjvm.dylib          0x96f283c8 JVM_GetClassAccessFlags +  
0x1168

3   libjvm.dylib          0x96f22d28 _mh_dylib_header + 0x2d28
4   libjvm.dylib          0x96f2c194 __cmpdi2 + 0x1ad4
5   libjvm.dylib          0x96f288a8 JVM_MonitorWait + 0x108
6   <<00000000>>     0x03f33580 0 + 0x3f33580
7   <<00000000>>     0x03f2cfb0 0 + 0x3f2cfb0
8   <<00000000>>     0x03f2cec0 0 + 0x3f2cec0
9   <<00000000>>     0x03f2cec0 0 + 0x3f2cec0
10  <<00000000>>     0x03f2a16c 0 + 0x3f2a16c
11  libjvm.dylib          0x96f3aff8 JVM_GetCPMethodClassNameUTF +
0xb38
12  libjvm.dylib          0x96f5c448 JVM_GetCPClassNameUTF + 0x998
13  libjvm.dylib          0x96f990a8 JVM_Close + 0x4b8
14  libjvm.dylib          0x96fa9970 JVM_Interrupt + 0x2e0
15  libjvm.dylib          0x9704e70c JVM_UnloadLibrary + 0xcdec
16  libjvm.dylib          0x96f94e04 JVM_FindClassFromClass + 0xc14
17  libjvm.dylib          0x970f290c JVM_UnloadLibrary + 0xb0fec
18  libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 6:
0   libSystem.B.dylib     0x90007878 mach_msg_trap + 0x8
1   libSystem.B.dylib     0x900073f8 mach_msg + 0x38

2   libjvm.dylib          0x96f28448 JVM_GetClassAccessFlags +  
0x11e8

3   libjvm.dylib          0x96f37f60 JVM_GetCPMethodSignatureUTF +
0x1810
4   libjvm.dylib          0x96f38100 JVM_GetCPMethodSignatureUTF +
0x19b0
5   libjvm.dylib          0x970f290c JVM_UnloadLibrary + 0xb0fec
6   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 7:
0   libSystem.B.dylib     0x90007878 mach_msg_trap + 0x8
1   libSystem.B.dylib     0x900073f8 mach_msg + 0x38

2   libjvm.dylib          0x96f283c8 JVM_GetClassAccessFlags +  
0x1168

3   libjvm.dylib          0x96f5b104 __divdi3 + 0x50f4
4   libjvm.dylib          0x96f92510 JVM_GetFieldIxModifiers + 0xb60
5   libjvm.dylib          0x96f7e2bc JVM_SocketAvailable + 0x130c
6   libjvm.dylib          0x96f94e04 JVM_FindClassFromClass + 0xc14
7   libjvm.dylib          0x970f290c JVM_UnloadLibrary + 0xb0fec
8   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 8:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 9:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 10:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 11:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 12:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 13 Crashed:
0   witangod              0x00068ef8 0x1000 + 0x67ef8
1   witangod              0x000482a8 0x1000 + 0x472a8
2   witangod              0x00069cc4 0x1000 + 0x68cc4
3   witangod              0x0006b300 0x1000 + 0x6a300
4   witangod              0x00019bdc 0x1000 + 0x18bdc
5   witangod              0x0001a1d4 0x1000 + 0x191d4
6   witangod              0x00017e0c 0x1000 + 0x16e0c
7   witangod              0x0001ac90 0x1000 + 0x19c90
8   witangod              0x0014e7d8 0x1000 + 0x14d7d8
9   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 14:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 15:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 16:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 17:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 18:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 19:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 20:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 21:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 22:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 23:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 24:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 25:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 26:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 27:
0   libSystem.B.dylib     0x90018e18
semaphore_timedwait_signal_trap + 0x8
1   libSystem.B.dylib     0x9000e9d4 _pthread_cond_wait + 0x268
2   witangod              0x0014ee08 0x1000 + 0x14de08
3   witangod              0x000052bc 0x1000 + 0x42bc
4   witangod              0x00004ab4 0x1000 + 0x3ab4
5   witangod              0x0001ab54 0x1000 + 0x19b54
6   witangod              0x0014e7d8 0x1000 + 0x14d7d8
7   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

Thread 28:
0   libSystem.B.dylib     0x9000b42c select + 0xc
1   witangod              0x0012a908 0x1000 + 0x129908
2   witangod              0x0012af98 0x1000 + 0x129f98
3   witangod              0x000050d8 0x1000 + 0x40d8
4   witangod              0x0014e7d8 0x1000 + 0x14d7d8
5   libSystem.B.dylib     0x90024910 _pthread_body + 0x28

PPC Thread State:

  srr0: 0x00068ef8 srr1: 0x0200f030                vrsave:  
0x00000000
    cr: 0x28000248  xer: 0x20000004   lr: 0x00068e6c  ctr:  
0x0014e0b4
    r0: 0x00000020   r1: 0xf068c770   r2: 0x00000000   r3:  
0x00000000
    r4: 0x00000000   r5: 0x10001690   r6: 0x80808080   r7:  
0x00000002
    r8: 0x2020002d   r9: 0xffffffff  r10: 0x0014da90  r11:  
0x00000002
   r12: 0x84000244  r13: 0x00000000  r14: 0x00000000  r15:  
0x00000000
   r16: 0x00000000  r17: 0x00000000  r18: 0x00000000  r19:  
0xffffffff
   r20: 0xffffffff  r21: 0x038dded0  r22: 0x038ddecf  r23:  
0x0000ffff
   r24: 0x02636964  r25: 0x0000002a  r26: 0x02515000  r27:  
0x00000018
   r28: 0x00000000  r29: 0x023f5928  r30: 0x026368d0  r31:  
0x00068c8c






Roland A. Dumas
310 W. Bellevue Ave.
San Mateo, CA 94402
650-347-1373
415-412-9300 (cell)
AIM: radumas
[EMAIL PROTECTED]



____________________________________________________________________ 
__

__
TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf





_____________________________________________________________________ 
___

TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf



______________________________________________________________________ 
__

TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf



________________________________________________________________________
TO UNSUBSCRIBE: Go to http://www.witango.com/developer/maillist.taf






















					Reply via email to