That's is pretty big, my personal experience with big files on udt was up to
about 60Gig - we did use memresize no problems - but had to set the TMPPATH
to another drive.



-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney
A (Rod) 46K
Sent: 26 April 2012 12:00
To: 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file

 Indexes and all, 91 G with about 75 million records.

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Symeon Breen
Sent: Thursday, April 26, 2012 4:08 AM
To: 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file

Out of interest, how big is this file and how many records ?


-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney
A (Rod) 46K
Sent: 25 April 2012 21:30
To: 'U2 Users List'; jonathan.lec...@blairswindows.co.uk
Subject: Re: [U2] Huge Dynamic Unidata file

 
        I think at the time I wrote this, Unidata 6 I think, I could not
even get memresize to handle overflow that was larger than 2 gigabytes. So I
thought the solution by Unidata was to create an overflow file for every dat
segment. I have never specified the OVERFLOW option when using memresize.
Plus, I rarely have enough space in a file system to handle 2 copies of one
of my big file. One work around for the file system space issue is to
symbolically link the original file in another file system. But that is a
lot of work when you have a lot of dat files. 



-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of
dean.armbrus...@ferguson.com
Sent: Wednesday, April 25, 2012 3:16 PM
To: u2-users@listserver.u2ug.org; jonathan.lec...@blairswindows.co.uk
Subject: Re: [U2] Huge Dynamic Unidata file

Were you using the OVERFLOW option with memresize?  If not, memresize should
not be creating the extra over files.  If memresize did create the extra
over files without the OVERFLOW option, then that would be a bug in
memresize. 

Dean Armbruster
System Analyst
757-989-2839

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Baakkonen, Rodney
A (Rod) 46K
Sent: Wednesday, April 25, 2012 12:29
To: 'Jonathan Leckie'; 'U2 Users List'
Subject: Re: [U2] Huge Dynamic Unidata file


 I resize most of my Dynamic files this way. I don't like having a small
overxxx segment for every datxxx segment that memresize creates.. By
creating the new file my self, I don't have a lot of these small overxxx
segments that are never used.

I also wrote a process to Select the old file and create a SAVELIST.
Without going into to much detail, the process uses PHANTOM to spawn off a
number of Unidata copies. So there are a number of simultaneous processes
working to build the new file. Each PHANTOM Copy knows how many total
phantoms are working on the file and what sequence IT is within the total
number of PHANTOMS. Each Phantom handles part of the SAVELIST. Each PHANTOM
does the iteration below until the list is
exhausted:

1. QSELECT SAVEDLISTS listname000. (process 2 would use 001, process 3 would
use 002 etc) 2. COPY FROM old.file TO new.file 3. Increment the list counter
from 000 by the number of Phantoms and go back to step one to process a new
segment of the savelist.
4. If a process cannot find the next savelist segment in SAVEDLISTS, it is
done.

This process is almost as fast as memresize. You can control what file
systems are used for space reasons and you don't get scads of overxxx
segments in your FILE.NAME directory (one of my dynamic files has 39 dat
segments and just a over001). 

So I don't use memresize for dynamic files anymore. 

-----Original Message-----
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Jonathan Leckie
Sent: Wednesday, April 25, 2012 9:36 AM
To: u2-users@listserver.u2ug.org
Subject: [U2] Huge Dynamic Unidata file

I have a very large  file that I don't have enough free space to memresize,
however howabout I create  new dynamic (temporary) file and then copy all
the records (in ECL) to the new  file and then (unix) copy the temporary
file over the top of the  original.
 
Does that seem like  a sensible idea?
 
 
Regards
Jonathan Leckie
 



**********************************************************
* This message has been scanned for viruses and dangerous content
* and is believed to be clean.            
*

* This email and any files transmitted with it are confidential and
* intended solely for the use of the individual or entity to whom they
* are addressed.
*
* If you have received this email in error please notify us at Blairs,
* details can be found on our website http://www.blairswindows.co.uk
*
* Name & Registered Office:
*
* Blairs Windows Limited
* Registered office : 9 Baker Street, Greenock, PA15 4TU
* Company No: SC393935, V.A.T. registration No: 108729111
**********************************************************
_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

------------------------------------------------------------------------
------
CONFIDENTIALITY NOTICE: If you have received this email in error, please
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This
information is intended only for the use of the individual(s) or entity to
whom it is intended even if addressed incorrectly.  Please delete it from
your files if you are not the intended recipient.  Thank you for your
compliance.  Copyright (c) 2012 Cigna
========================================================================
======

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

----------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE: If you have received this email in error, please
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This
information is intended only for the use of the individual(s) or entity to
whom it is intended even if addressed incorrectly.  Please delete it from
your files if you are not the intended recipient.  Thank you for your
compliance.  Copyright (c) 2012 Cigna
============================================================================
==

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1424 / Virus Database: 2411/4958 - Release Date: 04/25/12

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

----------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE: If you have received this email in error, please
immediately notify the sender by e-mail at the address shown.  
This email transmission may contain confidential information.  This
information is intended only for the use of the individual(s) or entity to
whom it is intended even if addressed incorrectly.  Please delete it from
your files if you are not the intended recipient.  Thank you for your
compliance.  Copyright (c) 2012 Cigna
============================================================================
==

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 10.0.1424 / Virus Database: 2411/4960 - Release Date: 04/26/12

_______________________________________________
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Reply via email to