[U2] Converting static to dynamic
We have two very large files from which I often have to remove data to stop the files reaching the 2GB limit, much as I enjoy removing this data my colleague has suggested that changing these files to be dynamic would mean we could allow them to hold more data and choose when to remove old data rather than be forced to. Does any one have any experiences that they wish to share regarding changing files in this way, e.g. file performance before and after, any practical steps required after conversion etc.? We are running red hat enterprise Linux 3 and unidata 6. -- A Striker is the same as a Keeper. -- * This message has been scanned for viruses and dangerous content by * Blairs MailScanner, and is believed to be clean. * * This email and any files transmitted with it are confidential and * intended solely for the use of the individual or entity to whom they * are addressed. * * If you have received this email in error please notify us at Blairs * via email at [EMAIL PROTECTED] * * Name Registered Office: * -- * Blairs Limited * 9 Baker Street * Greenock * PA15 4TU * Company No: SC132926 * VAT No: 554698690 --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] Converting static to dynamic
We run pretty much all of our files as dynamic although mainly because we write software for resale and it is much easier for a customer site to be managed if everything is dynamic. The main issue is to try and create the dynamic file at roughly the right size rather than creating it small and letting it grow. It will be quicker to copy and will perform better. Once created we haven't seen any serious performance issues so long as they are managed. It's not as serious as managing a static file but you do still have to keep an eye on them and resize them once in a while George Land APT Solutions Ltd On 24/7/07 09:05, Jonathan Leckie [EMAIL PROTECTED] wrote: We have two very large files from which I often have to remove data to stop the files reaching the 2GB limit, much as I enjoy removing this data my colleague has suggested that changing these files to be dynamic would mean we could allow them to hold more data and choose when to remove old data rather than be forced to. Does any one have any experiences that they wish to share regarding changing files in this way, e.g. file performance before and after, any practical steps required after conversion etc.? We are running red hat enterprise Linux 3 and unidata 6. ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify us immediately on +44 (01952) 214000 or at [EMAIL PROTECTED] . Please delete and destroy any copies in any format of this email you may have received in error. The recipient should note that the views contained or expressed within this correspondence do not necessarily reflect those of APT Solutions Limited , it subsidiaries, affiliates or associates. This email and any attachments are not guaranteed to be free from so-called computer viruses and it is recommended that you check for such viruses before down-loading it to your computer equipment. It is the responsibility of the recipient to ensure that the onward transmission, opening or use of this message or any attachments will not adversely affect their systems or data. Registered Office:- Stratum House, Stafford Park 10, Telford, Shropshire, TF3 3AB Registration Number:- 2228445 Place of Registration: England Wales ** --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] Converting static to dynamic
We have a dynamic file that is 65 gig. I would recommend that you invest some time experimenting with split/merge params and even possibly KEYDATA to see what works best with your file. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of Jonathan Leckie Sent: Tuesday, July 24, 2007 3:06 AM To: u2-users@listserver.u2ug.org Subject: [U2] Converting static to dynamic We have two very large files from which I often have to remove data to stop the files reaching the 2GB limit, much as I enjoy removing this data my colleague has suggested that changing these files to be dynamic would mean we could allow them to hold more data and choose when to remove old data rather than be forced to. Does any one have any experiences that they wish to share regarding changing files in this way, e.g. file performance before and after, any practical steps required after conversion etc.? We are running red hat enterprise Linux 3 and unidata 6. -- A Striker is the same as a Keeper. -- * This message has been scanned for viruses and dangerous content by * Blairs MailScanner, and is believed to be clean. * * This email and any files transmitted with it are confidential and * intended solely for the use of the individual or entity to whom they * are addressed. * * If you have received this email in error please notify us at Blairs * via email at [EMAIL PROTECTED] * * Name Registered Office: * -- * Blairs Limited * 9 Baker Street * Greenock * PA15 4TU * Company No: SC132926 * VAT No: 554698690 --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] Converting static to dynamic
Use hash type 1. Use KEYONLY splitting. Choose a reasonable starting modulo Experiment with SPLIT.LOAD and MERGE.LOAD. The file will probably be twice as slow as a perfectly sized static file but who cares. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jonathan Leckie Sent: Tuesday, July 24, 2007 4:06 AM To: u2-users@listserver.u2ug.org Subject: [U2] Converting static to dynamic We have two very large files from which I often have to remove data to stop the files reaching the 2GB limit, much as I enjoy removing this data my colleague has suggested that changing these files to be dynamic would mean we could allow them to hold more data and choose when to remove old data rather than be forced to. Does any one have any experiences that they wish to share regarding changing files in this way, e.g. file performance before and after, any practical steps required after conversion etc.? We are running red hat enterprise Linux 3 and unidata 6. -- A Striker is the same as a Keeper. -- * This message has been scanned for viruses and dangerous content by * Blairs MailScanner, and is believed to be clean. * * This email and any files transmitted with it are confidential and * intended solely for the use of the individual or entity to whom they * are addressed. * * If you have received this email in error please notify us at Blairs * via email at [EMAIL PROTECTED] * * Name Registered Office: * -- * Blairs Limited * 9 Baker Street * Greenock * PA15 4TU * Company No: SC132926 * VAT No: 554698690 --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] Converting static to dynamic
KEYONLY would not work for us for the most part. We have File Keys that were 10-15 characters. Our record sizes would be 300-800. So we would never get enough Keys in a group to cause splitting. KEYDATA works fine in 90% of our files. But we have files that have meaningful keys that do not hash well. Keys like this do poorly with hashing in Unidata: [EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED] And they are a disaster with KEYDATA. Splitting happens continuously as the hashing causes records to hash to the same groups even after the split. So I had to go back to KEYONLY and I manually have to resize these files with meaningful keys on a yearly basis. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of Dave Davis Sent: Tuesday, July 24, 2007 8:27 AM To: u2-users@listserver.u2ug.org Subject: RE: [U2] Converting static to dynamic Use hash type 1. Use KEYONLY splitting. Choose a reasonable starting modulo Experiment with SPLIT.LOAD and MERGE.LOAD. The file will probably be twice as slow as a perfectly sized static file but who cares. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jonathan Leckie Sent: Tuesday, July 24, 2007 4:06 AM To: u2-users@listserver.u2ug.org Subject: [U2] Converting static to dynamic We have two very large files from which I often have to remove data to stop the files reaching the 2GB limit, much as I enjoy removing this data my colleague has suggested that changing these files to be dynamic would mean we could allow them to hold more data and choose when to remove old data rather than be forced to. Does any one have any experiences that they wish to share regarding changing files in this way, e.g. file performance before and after, any practical steps required after conversion etc.? We are running red hat enterprise Linux 3 and unidata 6. -- A Striker is the same as a Keeper. -- * This message has been scanned for viruses and dangerous content by * Blairs MailScanner, and is believed to be clean. * * This email and any files transmitted with it are confidential and * intended solely for the use of the individual or entity to whom they * are addressed. * * If you have received this email in error please notify us at Blairs * via email at [EMAIL PROTECTED] * * Name Registered Office: * -- * Blairs Limited * 9 Baker Street * Greenock * PA15 4TU * Company No: SC132926 * VAT No: 554698690 --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
