gendh 1024 hang: VC-WIN32 dlls

[Scott Krueger]

0.9.4; Win98 or NT4; MSVC++6.0. built the files using instructions in install.w32 (including configure). The ms test files run fine.   Working with Libeay32 to do DH generation, I ended up with occasional system lock ups while generating parameters.  No debugger indications of the problem, can't seem to find it.  The lock ups are very hard -- no mouse movement, no 3 finger salute, have to power off.   To see if it was my working code, I tried "openssl gendh 1024" from the command line.  80% of the time this hung me.  "openssl gendh 2048" hangs 100% of the time. "openssl gendh 512" always works.  I changed the code in gendh.c to loop through calling the main function 10 times with 512.  It hangs between the 2nd and 5th time.   Starting from scratch to a new directory, I unzipped the 0.9.4 source, followed the install.w32 instructions.  Then downloaded the MSVC project files from http://www.iconsinc.com/~agray/ossldev/VC6openssl.zip.  Followed the instructions. Rebuilt everything in debug.  Ran "openssl gendh 2048" and got a hard hang.  Same thing when I run gendh.exe directly from the project files in the debugger. I'm really at a loss where the problem is, and I desprately need stable code with 1024 parameter generation.  Any suggestions? (besides getting a real operating system).  Does the command "openssl gendh 2048" work for anybody in the windows environment?   Could the cast error in crypto\bn\bn_div.c line 241 be related to the problem?