Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Symeon Breen
...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file I think at the time I wrote this, Unidata 6 I think, I could not even get memresize to handle overflow that was larger than 2 gigabytes. So I thought the solution by Unidata was to create an overflow file for every dat segment. I have

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Baakkonen, Rodney A (Rod) 46K
...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file I think at the time I wrote this, Unidata 6 I think, I could not even get memresize to handle overflow that was larger than 2 gigabytes. So I thought the solution by Unidata was to create an overflow file for every dat segment. I have

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Symeon Breen
] On Behalf Of Baakkonen, Rodney A (Rod) 46K Sent: 26 April 2012 12:00 To: 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file Indexes and all, 91 G with about 75 million records. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org

Re: [U2] Huge Dynamic Unidata file

2012-04-26 Thread Symeon Breen
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen Sent: Thursday, April 26, 2012 6:18 AM To: 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file That's is pretty big, my personal experience with big files on udt was up to about 60Gig - we did use memresize no problems

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Dave Henderson
Hi, That will work, I have done that many times. Just make sure you check the permissions at unix level after the copy. Dave I have a very large file that I don't have enough free space to memresize, however howabout I create new dynamic (temporary) file and then copy all the records (in

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread John Jenkins
We've recently added a new UniData tuneable to udtconfig UDT_SPLIT_POLICY which can help conserve space when an overflowed dynamic file splits. The total size of the contents are not necessarily the same as the physical file size. Always worth checking with guide and the latest fixes and

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Israel, John R.
AM To: Jonathan Leckie; U2 Users List Cc: u2-users@listserver.u2ug.org Subject: Re: [U2] Huge Dynamic Unidata file Hi, That will work, I have done that many times. Just make sure you check the permissions at unix level after the copy. Dave I have a very large file that I don't have enough free

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Baakkonen, Rodney A (Rod) 46K
I resize most of my Dynamic files this way. I don't like having a small overxxx segment for every datxxx segment that memresize creates.. By creating the new file my self, I don't have a lot of these small overxxx segments that are never used. I also wrote a process to Select the old file and

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Dean.Armbruster
- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney A (Rod) 46K Sent: Wednesday, April 25, 2012 12:29 To: 'Jonathan Leckie'; 'U2 Users List' Subject: Re: [U2] Huge Dynamic Unidata file I resize most of my Dynamic files

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Wols Lists
On 25/04/12 15:46, John Jenkins wrote: We've recently added a new UniData tuneable to udtconfig UDT_SPLIT_POLICY which can help conserve space when an overflowed dynamic file splits. The total size of the contents are not necessarily the same as the physical file size. Always worth

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread Baakkonen, Rodney A (Rod) 46K
Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of dean.armbrus...@ferguson.com Sent: Wednesday, April 25, 2012 3:16 PM To: u2-users@listserver.u2ug.org; jonathan.lec...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread John Jenkins
Yes, absolutely - I'm a great believer in a minimum modulo. If I have to copy large files from one to another my preferred method is to drive a load of PHANTOMs with save-lists in parallel. Also useful to drive from a SELECT not a SSELECT so you get a file-sequential order by chunking the input

Re: [U2] Huge Dynamic Unidata file

2012-04-25 Thread John Jenkins
...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of dean.armbrus...@ferguson.com Sent: Wednesday, April 25, 2012 3:16 PM To: u2-users@listserver.u2ug.org; jonathan.lec...@blairswindows.co.uk Subject: Re: [U2] Huge Dynamic Unidata file Were you using the OVERFLOW option