RE: [U2] System Migration issues
Could you T-Load them to a virtual tape file (.vtf) and then ftp that to wherever you want? R. Baker Hughes UniVerse Programming Mouser Electronics, Inc. I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] System Migration issues
You didn't say which U2 product, which makes all the difference in the world for this answer. So, because I know a bit of this on Universe, I'll target my answer at that DBMS. My experience with distributed file transfers is that FTP is fine. HOWEVER, when the file is on the new system, you must run fnuxi on the file before doing anything else. Fnuxi clears the distributed parts out of the file header, thus making it a standard hashed file again. So, the main file has to be removed and then the file re-distributed. The Partfile algorithm is hard-coded in each file's header as is the absolute path to each partfile. HTH Karl quote who=Sirulnick, Steve I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ -- karl _/ _/ _/ _/_/_/ __o _/ _/ _/ _/_/ _-\._ _/_/_/ _/_/_/ (_)/ (_) _/ _/ _/ _/ .. _/ _/ arl _/_/_/ _/ earson[EMAIL PROTECTED] -- IT Director, ATS Industrial Supply, Inc. http://www.atsindustrial.com Toll-free: 800-789-9300 x29 Direct2Desk: 801-978-4429 Facsimile: 801-972-3888 -- --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] System Migration issues
[EMAIL PROTECTED] wrote: I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Two possible problems. You ARE transferring them in ftp in binary mode? And you have run the clean-up tool that corrects the byte order? (I think that's what Karl is talking about) You might also find it easier to do a UVBACKUP and then restore that, because that (I think) gets round all the endian issues and that sort of stuff. Cheers, Wol --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
If it is UniData - you probably need to consider the endian of the files (which is the same consideration in fact if it is UniVerse). So - you would need to run convdata, convidx, convcode and quite possibly convmark. Each are fairly well documented in the manuals - but my guess is that will fix the problem if you are UniData based. If it is UniVerse, FORMAT.CONV (which is what fnuxi was renamed to be), is your answer. Hope that helps. This e-mail is for the use of the intended recipient(s) only. If you have received this e-mail in error, please notify the sender immediately and then delete it. If you are not the intended recipient, you must not use, disclose or distribute this e-mail without the author's prior permission. We have taken precautions to minimize the risk of transmitting software viruses, but we advise you to carry out your own virus checks on any attachment to this message. We cannot accept liability for any loss or damage caused by software viruses. --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] System Migration issues
Hello Steve, Are you setting the FTP transfer process to binary mode before doing the transfer? What versions of UniVerse or UniData? Any compatible tape device between the servers? Have you tried a process similar to the following: 1) creating a type 1 file 2) copying data from larger distributed file to the type 1 file 3) compress the type 1 file 4) ftp using binary mode 5) uncompress on new server 6) manually create the new larger distributed file 7) copy from the Type 1 file to the newly created distributed file That is one approach - can probably come up with a few other ideas. I am local to you in the greater Boston area, and have some expertise in server migrations and U2 environments. Can I be of some assistance? Regards, Scott Richardson Senior Systems Engineer / Consultant Marlborough, MA 01752 888-912-9681 SkyPage (numeric voice mail paging) Email: [EMAIL PROTECTED] Web: http://home.comcast.net/~CheetahFTL/CC/CheetahFTL_1.htm - Original Message - From: Sirulnick, Steve [EMAIL PROTECTED] To: u2-users@listserver.u2ug.org Sent: Thursday, January 12, 2006 9:42 AM Subject: [U2] System Migration issues I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] System Migration issues
Test your assumption by performing some manner of CRC on the files before and after transit. If you can perform an md5 checksum on AIX, Redhat will have a compatible program called md5sum. But realistically, ftp file transfer should have nil affect on the files. -Mike Doyle Unix Developer / Administrator AMO Recoveries On Thu, 2006-01-12 at 09:42 -0500, Sirulnick, Steve wrote: I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] System Migration issues
Your source files are not in use by chance are they? If so that could be your problem. You may be catching 1/2 of a write when the copy is being transferred. At 08:42 AM 1/12/2006, you wrote: I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. Doug Miller [EMAIL PROTECTED] Manager of Technical Services Strategy 7Dallas TX --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
Here's more information: I am using universe and ran fnuxi (transferring in binary mode is a given). I have also tried removing the file header with no joy. I've tried to rebuild the header, but the partfiles were damaged. It could be because the algorithm may have been different from one system to the other when trying to rebuild. Even so, is there a quicker way of repairing the file headers so they can be rebuild or created again? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 10:36 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] System Migration issues You didn't say which U2 product, which makes all the difference in the world for this answer. So, because I know a bit of this on Universe, I'll target my answer at that DBMS. My experience with distributed file transfers is that FTP is fine. HOWEVER, when the file is on the new system, you must run fnuxi on the file before doing anything else. Fnuxi clears the distributed parts out of the file header, thus making it a standard hashed file again. So, the main file has to be removed and then the file re-distributed. The Partfile algorithm is hard-coded in each file's header as is the absolute path to each partfile. HTH Karl quote who=Sirulnick, Steve I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ -- karl _/ _/ _/ _/_/_/ __o _/ _/ _/ _/_/ _-\._ _/_/_/ _/_/_/ (_)/ (_) _/ _/ _/ _/ .. _/ _/ arl _/_/_/ _/ earson[EMAIL PROTECTED] -- IT Director, ATS Industrial Supply, Inc. http://www.atsindustrial.com Toll-free: 800-789-9300 x29 Direct2Desk: 801-978-4429 Facsimile: 801-972-3888 -- --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
Michael Doyle wrote on 01/12/2006 12:52:14 PM: If AIX used \n as a line terminator (in keeping with standard UNIX practice,) binary vs ascii mode would not be an issue, but according to the ever-accurate wikipedia, it uses EBCDIC 0x15: http://en.wikipedia.org/wiki/Newline Since anybody can post anything into a wiki, any information contained therein should be taken with a huge grain of salt. AIX is a UNIX system, not a mainframe system, as claimed in the link. It uses ASCII, not EBCDIC. You can move text files directly between AIX and any other UNIX without problems. Besides, binary files like databases should - as pointed out by many other posters - be moved with binary mode, which means that the line terminator issue is not a factor. We need to hear back from the OP as to whether binary mode was used and what was meant by converting the files for Linux use. Then we can get closer to a solution. Tim Snyder Consulting I/T Specialist , U2 Professional Services North American Lab Services DB2 Information Management, IBM Software Group 717-545-6403 [EMAIL PROTECTED] --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
Thank you for all your emails. I will even get more specific so I don't waste your time. When trying to run a REBUILD.DF, it could not read or find the header. When I tried to remove the header and tried to DEFINE.DF, I got a message saying that the partblocks were bad. This is when I used the fixtool utility on the first set of distributed files. I was then able to perform a DEFINE.DF and recreate my data. This was the first set, however. The second set of data is still running under fixtool but it has been running for almost 13 hours on only one distributed file (I have 9 more to go!). Of course, this is a test in preparation for the live migration; however, I will not have that kind of downtime when performing the migration. If I can do something better, I would like to know. Many Thanks! -Original Message- From: Sirulnick, Steve [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 1:03 PM To: 'u2-users@listserver.u2ug.org' Subject: RE: [U2] System Migration issues Here's more information: I am using universe and ran fnuxi (transferring in binary mode is a given). I have also tried removing the file header with no joy. I've tried to rebuild the header, but the partfiles were damaged. It could be because the algorithm may have been different from one system to the other when trying to rebuild. Even so, is there a quicker way of repairing the file headers so they can be rebuild or created again? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 10:36 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] System Migration issues You didn't say which U2 product, which makes all the difference in the world for this answer. So, because I know a bit of this on Universe, I'll target my answer at that DBMS. My experience with distributed file transfers is that FTP is fine. HOWEVER, when the file is on the new system, you must run fnuxi on the file before doing anything else. Fnuxi clears the distributed parts out of the file header, thus making it a standard hashed file again. So, the main file has to be removed and then the file re-distributed. The Partfile algorithm is hard-coded in each file's header as is the absolute path to each partfile. HTH Karl quote who=Sirulnick, Steve I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ -- karl _/ _/ _/ _/_/_/ __o _/ _/ _/ _/_/ _-\._ _/_/_/ _/_/_/ (_)/ (_) _/ _/ _/ _/ .. _/ _/ arl _/_/_/ _/ earson[EMAIL PROTECTED] -- IT Director, ATS Industrial Supply, Inc. http://www.atsindustrial.com Toll-free: 800-789-9300 x29 Direct2Desk: 801-978-4429 Facsimile: 801-972-3888 -- --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
I don't know if fixtool works the same way as fnuxi used to, but when I ran it (and I apologize for not mentioning it earlier), it would run forever, as you're seeing now, when going through the file. Since the header was the only thing that had issues, I found that I could do: fnuxi FILENAME and then after about 15 seconds, just hit CTRL-C and terminate the fnuxi process. Then I could do DEFINE.DF . . . . and the file was back up. Since you've lost 13 hours already, I don't know if I'd attempt a break. It might just finish in 2 more minutes... Karl quote who=Sirulnick, Steve Thank you for all your emails. I will even get more specific so I don't waste your time. When trying to run a REBUILD.DF, it could not read or find the header. When I tried to remove the header and tried to DEFINE.DF, I got a message saying that the partblocks were bad. This is when I used the fixtool utility on the first set of distributed files. I was then able to perform a DEFINE.DF and recreate my data. This was the first set, however. The second set of data is still running under fixtool but it has been running for almost 13 hours on only one distributed file (I have 9 more to go!). Of course, this is a test in preparation for the live migration; however, I will not have that kind of downtime when performing the migration. If I can do something better, I would like to know. Many Thanks! -Original Message- From: Sirulnick, Steve [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 1:03 PM To: 'u2-users@listserver.u2ug.org' Subject: RE: [U2] System Migration issues Here's more information: I am using universe and ran fnuxi (transferring in binary mode is a given). I have also tried removing the file header with no joy. I've tried to rebuild the header, but the partfiles were damaged. It could be because the algorithm may have been different from one system to the other when trying to rebuild. Even so, is there a quicker way of repairing the file headers so they can be rebuild or created again? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 10:36 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] System Migration issues You didn't say which U2 product, which makes all the difference in the world for this answer. So, because I know a bit of this on Universe, I'll target my answer at that DBMS. My experience with distributed file transfers is that FTP is fine. HOWEVER, when the file is on the new system, you must run fnuxi on the file before doing anything else. Fnuxi clears the distributed parts out of the file header, thus making it a standard hashed file again. So, the main file has to be removed and then the file re-distributed. The Partfile algorithm is hard-coded in each file's header as is the absolute path to each partfile. HTH Karl quote who=Sirulnick, Steve I am migrating an old AIX server running U2 to RH Linux. Because of the server's limitations, I need to transfer files between the two devices via FTP and then converting the files for Linux use. After doing so, my distributed files are getting corrupted. It looks like the IBM provided fixtool utility repairs the files, but it's taking way too long for my larger distributed files. Making a HUGE assumption that it's the file transfer responsible for the file corruption, is there a preferred method for copying data files? Steve --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ -- karl _/ _/ _/ _/_/_/ __o _/ _/ _/ _/_/ _-\._ _/_/_/ _/_/_/ (_)/ (_) _/ _/ _/ _/ .. _/ _/ arl _/_/_/ _/ earson[EMAIL PROTECTED] -- IT Director, ATS Industrial Supply, Inc. http://www.atsindustrial.com Toll-free: 800-789-9300 x29 Direct2Desk: 801-978-4429 Facsimile: 801-972-3888 -- --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ -- karl _/ _/ _/ _/_/_/ __o _/ _/ _/ _/_/ _-\._ _/_/_/ _/_/_/ (_)/ (_) _/ _/ _/ _/ .. _/ _/ arl _/_/_/ _/ earson[EMAIL PROTECTED] -- IT Director, ATS Industrial Supply, Inc. http://www.atsindustrial.com Toll-free: 800-789-9300 x29 Direct2Desk: 801-978-4429 Facsimile: 801-972-3888 -- --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
I had the same problem with a migration from a Data General to an AIX/UniVerse 10.1.7. I undid the distribution on the Data General, did the migration, and re-build the distribution on the UniVerse side and it worked fine. The problem is that when you migrate the file, it actually get created anew and the header information is lost from you original system. HTH Tom Dodds [EMAIL PROTECTED] 708-234-9608 Office 630-235-2975 Cell -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Sirulnick, Steve Sent: Thursday, January 12, 2006 2:53 PM To: 'u2-users@listserver.u2ug.org' Subject: RE: [U2] System Migration issues Thank you for all your emails. I will even get more specific so I don't waste your time. When trying to run a REBUILD.DF, it could not read or find the header. When I tried to remove the header and tried to DEFINE.DF, I got a message saying that the partblocks were bad. This is when I used the fixtool utility on the first set of distributed files. I was then able to perform a DEFINE.DF and recreate my data. This was the first set, however. The second set of data is still running under fixtool but it has been running for almost 13 hours on only one distributed file (I have 9 more to go!). Of course, this is a test in preparation for the live migration; however, I will not have that kind of downtime when performing the migration. If I can do something better, I would like to know. Many Thanks! 2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
Thanks Tom. This worked perfectly. I saved my dictionaries before I removed the distributed file header then added it later after I created the new DF header. -Original Message- From: Tom Dodds [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 4:03 PM To: u2-users@listserver.u2ug.org Subject: RE: [U2] System Migration issues I had the same problem with a migration from a Data General to an AIX/UniVerse 10.1.7. I undid the distribution on the Data General, did the migration, and re-build the distribution on the UniVerse side and it worked fine. The problem is that when you migrate the file, it actually get created anew and the header information is lost from you original system. HTH Tom Dodds [EMAIL PROTECTED] 708-234-9608 Office 630-235-2975 Cell -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Sirulnick, Steve Sent: Thursday, January 12, 2006 2:53 PM To: 'u2-users@listserver.u2ug.org' Subject: RE: [U2] System Migration issues Thank you for all your emails. I will even get more specific so I don't waste your time. When trying to run a REBUILD.DF, it could not read or find the header. When I tried to remove the header and tried to DEFINE.DF, I got a message saying that the partblocks were bad. This is when I used the fixtool utility on the first set of distributed files. I was then able to perform a DEFINE.DF and recreate my data. This was the first set, however. The second set of data is still running under fixtool but it has been running for almost 13 hours on only one distributed file (I have 9 more to go!). Of course, this is a test in preparation for the live migration; however, I will not have that kind of downtime when performing the migration. If I can do something better, I would like to know. Many Thanks! 2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] System Migration issues
Thanks, that's what being a consultant is worth, not the money, it worked, it helped. Tom Dodds [EMAIL PROTECTED] 708-234-9608 Office 630-235-2975 Cell -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Sirulnick, Steve Sent: Thursday, January 12, 2006 9:33 PM To: 'u2-users@listserver.u2ug.org' Subject: RE: [U2] System Migration issues Thanks Tom. This worked perfectly. I saved my dictionaries before I removed the distributed file header then added it later after I created the new DF header. -Original Message- From: Tom Dodds [mailto:[EMAIL PROTECTED] Sent: Thursday, January 12, 2006 4:03 PM To: u2-users@listserver.u2ug.org Subject: RE: [U2] System Migration issues I had the same problem with a migration from a Data General to an AIX/UniVerse 10.1.7. I undid the distribution on the Data General, did the migration, and re-build the distribution on the UniVerse side and it worked fine. The problem is that when you migrate the file, it actually get created anew and the header information is lost from you original system. HTH Tom Dodds [EMAIL PROTECTED] 708-234-9608 Office 630-235-2975 Cell -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Sirulnick, Steve Sent: Thursday, January 12, 2006 2:53 PM To: 'u2-users@listserver.u2ug.org' Subject: RE: [U2] System Migration issues Thank you for all your emails. I will even get more specific so I don't waste your time. When trying to run a REBUILD.DF, it could not read or find the header. When I tried to remove the header and tried to DEFINE.DF, I got a message saying that the partblocks were bad. This is when I used the fixtool utility on the first set of distributed files. I was then able to perform a DEFINE.DF and recreate my data. This was the first set, however. The second set of data is still running under fixtool but it has been running for almost 13 hours on only one distributed file (I have 9 more to go!). Of course, this is a test in preparation for the live migration; however, I will not have that kind of downtime when performing the migration. If I can do something better, I would like to know. Many Thanks! 2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
