I'm seeking advice on tuning a dynamic file in Unidata. In short, the file
has a numeric (sequential) key and contains only about 10 small fields: date,
time, user, etc and a single 'large' field: a block of text. The text can be
anywhere from one sentence to pages in length, hence I know this is going to
be a lumpy file as the records will vary wildly in size. Records will never
be deleted, and we add about 4000 new records/month. I converted this from
static to dynamic knowing I'd hit the 2gig limit in a couple of years.
The file is behaving fine, I'm just trying to see if I can find some better
parameters for it, and a dynamic files are my weakest area in Unidata. Here
are the current parameters:
File name(Dynamic File) = H08.CR.FF.TEXT
Number of groups in file (modulo) = 15511
Dynamic hashing, hash type = 0
Split/Merge type = KEYONLY
Block size = 4096
File has 15294 groups in level one overflow.
Number of records = 133578
Total number of bytes = 180532137
Average number of records per group = 8.6
Standard deviation from average = 1.1
Average number of bytes per group = 11639.0
Standard deviation from average = 6392.6
Average number of bytes in a record = 1351.5
Average number of bytes in record ID = 6.4
Standard deviation from average = 2080.9
Minimum number of bytes in a record = 51
Maximum number of bytes in a record = 105864
Minimum number of fields in a record = 14
Maximum number of fields in a record = 14
Average number of fields per record = 14.0
In particular, I'm curious about better choices for split/merge loads:
Dynamic File name = H08.CR.FF.TEXT
Number of groups in file (modulo) = 15511
Minimum groups of file = 15511
Hash type = 0, blocksize = 4096
Split load = 20, Merge load = 10
Split/Merge type = KEYONLY
Any insight or comments appreciated.
--
Jeff Butera, Ph.D.
Administrative Systems
Hampshire College
[EMAIL PROTECTED]
413-559-5556
"...our behavior matters more than the beliefs that we profess."
Elizabeth Deutsch Earle
-------
u2-users mailing list
[email protected]
To unsubscribe please visit http://listserver.u2ug.org/
