Re: [U2] Can of worms FILE.STATUS

2012-06-21 Thread Daniel McGrath 
Note, this would be assuming 1 record per group, which would me you should be 
selecting the next valid modulo above the expected number of records.

If you keep the same modulo, you have roughly 6.5 records per group. That would 
mean use 1 STD DEV the block size should be > 6000 (aka, 8kb). 2 STD DEV would 
put your block size at > 7839 (still 8kb)

Feel free to correct me, as I might have completely lost the plot.

Regards,
Dan

-Original Message-
From: u2-users-boun...@listserver.u2ug.org 
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Mecki Foerthmann
Sent: Thursday, June 21, 2012 11:00 AM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Can of worms FILE.STATUS

Well, the average record size is about 640 Bytes and according to the Standard 
deviation of 283 over 95% of records should be smaller than 2K so I would use a 
2K Blocksize not 4.

Since it's a dynamic file the modulo probably doesn't matter that much - but 
then I am fairly new to dynamic files so I guess 740972 is OK.



On 20/06/2012 18:21, Dave Laansma wrote:
> Mecki,
>
> What block size and why?
>
> Sincerely,
> David Laansma
> IT Manager
> Hubbard Supply Co.
> Direct: 810-342-7143
> Office: 810-234-8681
> Fax: 810-234-6142
> www.hubbardsupply.com
> "Delivering Products, Services and Innovative Solutions"
>
> -Original Message-
> From: u2-users-boun...@listserver.u2ug.org
> [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Mecki
> Foerthmann
> Sent: Wednesday, June 20, 2012 12:45 PM
> To: u2-users@listserver.u2ug.org
> Subject: Re: [U2] Can of worms FILE.STATUS
>
> Nothing really -  less than 10% overflow is not too bad.
> I would have chosen a smaller block size though.
>
> On 20/06/2012 17:20, Dave Laansma wrote:
>> I have my thoughts already in place but I'd like to hear input on
> this.
>> What is wrong with this file?
>>
>>
>>
>> File name(Dynamic File)   = OHL
>>
>> Number of groups in file (modulo) = 740972
>>
>> Dynamic hashing, hash type= 0
>>
>> Split/Merge type  = KEYONLY
>>
>> Block size= 4096
>>
>> File has 455028 groups in level one overflow.
>>
>> Number of records = 4835502
>>
>> Total number of bytes = 3100999567
>>
>>
>>
>> Average number of records per group   = 6.5
>>
>> Standard deviation from average   = 2.4
>>
>> Average number of bytes per group = 4185.0
>>
>> Standard deviation from average   = 1856.2
>>
>>
>>
>> Average number of bytes in a record   = 641.3
>>
>> Average number of bytes in record ID  = 14.8
>>
>> Standard deviation from average   = 283.6
>>
>> Minimum number of bytes in a record   = 133
>>
>> Maximum number of bytes in a record   = 8622
>>
>>
>>
>> Minimum number of fields in a record  = 110
>>
>> Maximum number of fields in a record  = 334
>>
>> Average number of fields per record   = 218.3
>>
>> Standard deviation from average   = 47.9
>>
>> File has 2 over files, 3 prime files
>>
>>
>>
>> Sincerely,
>>
>> David Laansma
>>
>> IT Manager
>>
>> Hubbard Supply Co.
>>
>> Direct: 810-342-7143
>>
>> Office: 810-234-8681
>>
>> Fax: 810-234-6142
>>
>> www.hubbardsupply.com<http://www.hubbardsupply.com>
>>
>> "Delivering Products, Services and Innovative Solutions"
>>
>>
>>
>> ___
>> U2-Users mailing list
>> U2-Users@listserver.u2ug.org
>> http://listserver.u2ug.org/mailman/listinfo/u2-users
>>
> ___
> U2-Users mailing list
> U2-Users@listserver.u2ug.org
> http://listserver.u2ug.org/mailman/listinfo/u2-users
> ___
> U2-Users mailing list
> U2-Users@listserver.u2ug.org
> http://listserver.u2ug.org/mailman/listinfo/u2-users
>

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] Can of worms FILE.STATUS

2012-06-21 Thread Mecki Foerthmann 
Well, the average record size is about 640 Bytes and according to the 
Standard deviation of 283 over 95% of records should be smaller than 2K 
so I would use a 2K Blocksize not 4.


Since it's a dynamic file the modulo probably doesn't matter that much - 
but then I am fairly new to dynamic files so I guess 740972 is OK.




On 20/06/2012 18:21, Dave Laansma wrote:

Mecki,

What block size and why?

Sincerely,
David Laansma
IT Manager
Hubbard Supply Co.
Direct: 810-342-7143
Office: 810-234-8681
Fax: 810-234-6142
www.hubbardsupply.com
"Delivering Products, Services and Innovative Solutions"

-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Mecki
Foerthmann
Sent: Wednesday, June 20, 2012 12:45 PM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Can of worms FILE.STATUS

Nothing really -  less than 10% overflow is not too bad.
I would have chosen a smaller block size though.

On 20/06/2012 17:20, Dave Laansma wrote:

I have my thoughts already in place but I'd like to hear input on

this.

What is wrong with this file?



File name(Dynamic File)   = OHL

Number of groups in file (modulo) = 740972

Dynamic hashing, hash type= 0

Split/Merge type  = KEYONLY

Block size= 4096

File has 455028 groups in level one overflow.

Number of records = 4835502

Total number of bytes = 3100999567



Average number of records per group   = 6.5

Standard deviation from average   = 2.4

Average number of bytes per group = 4185.0

Standard deviation from average   = 1856.2



Average number of bytes in a record   = 641.3

Average number of bytes in record ID  = 14.8

Standard deviation from average   = 283.6

Minimum number of bytes in a record   = 133

Maximum number of bytes in a record   = 8622



Minimum number of fields in a record  = 110

Maximum number of fields in a record  = 334

Average number of fields per record   = 218.3

Standard deviation from average   = 47.9

File has 2 over files, 3 prime files



Sincerely,

David Laansma

IT Manager

Hubbard Supply Co.

Direct: 810-342-7143

Office: 810-234-8681

Fax: 810-234-6142

www.hubbardsupply.com<http://www.hubbardsupply.com>

"Delivering Products, Services and Innovative Solutions"



___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users



___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] Can of worms FILE.STATUS

2012-06-20 Thread Dave Laansma 
Mecki,

What block size and why?

Sincerely,
David Laansma
IT Manager
Hubbard Supply Co.
Direct: 810-342-7143
Office: 810-234-8681
Fax: 810-234-6142
www.hubbardsupply.com
"Delivering Products, Services and Innovative Solutions"

-Original Message-
From: u2-users-boun...@listserver.u2ug.org
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Mecki
Foerthmann
Sent: Wednesday, June 20, 2012 12:45 PM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Can of worms FILE.STATUS

Nothing really -  less than 10% overflow is not too bad.
I would have chosen a smaller block size though.

On 20/06/2012 17:20, Dave Laansma wrote:
> I have my thoughts already in place but I'd like to hear input on
this.
> What is wrong with this file?
>
>
>
> File name(Dynamic File)   = OHL
>
> Number of groups in file (modulo) = 740972
>
> Dynamic hashing, hash type= 0
>
> Split/Merge type  = KEYONLY
>
> Block size= 4096
>
> File has 455028 groups in level one overflow.
>
> Number of records = 4835502
>
> Total number of bytes = 3100999567
>
>
>
> Average number of records per group   = 6.5
>
> Standard deviation from average   = 2.4
>
> Average number of bytes per group = 4185.0
>
> Standard deviation from average   = 1856.2
>
>
>
> Average number of bytes in a record   = 641.3
>
> Average number of bytes in record ID  = 14.8
>
> Standard deviation from average   = 283.6
>
> Minimum number of bytes in a record   = 133
>
> Maximum number of bytes in a record   = 8622
>
>
>
> Minimum number of fields in a record  = 110
>
> Maximum number of fields in a record  = 334
>
> Average number of fields per record   = 218.3
>
> Standard deviation from average   = 47.9
>
> File has 2 over files, 3 prime files
>
>
>
> Sincerely,
>
> David Laansma
>
> IT Manager
>
> Hubbard Supply Co.
>
> Direct: 810-342-7143
>
> Office: 810-234-8681
>
> Fax: 810-234-6142
>
> www.hubbardsupply.com<http://www.hubbardsupply.com>
>
> "Delivering Products, Services and Innovative Solutions"
>
>
>
> ___
> U2-Users mailing list
> U2-Users@listserver.u2ug.org
> http://listserver.u2ug.org/mailman/listinfo/u2-users
>

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] Can of worms FILE.STATUS

2012-06-20 Thread George Gallen 
The file size is 3.1gb . Isn't that the UV limit?

George

-Original Message-
From: u2-users-boun...@listserver.u2ug.org 
[mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Mecki Foerthmann
Sent: Wednesday, June 20, 2012 12:45 PM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Can of worms FILE.STATUS

Nothing really -  less than 10% overflow is not too bad.
I would have chosen a smaller block size though.

On 20/06/2012 17:20, Dave Laansma wrote:
> I have my thoughts already in place but I'd like to hear input on this.
> What is wrong with this file?
>
>
>
> File name(Dynamic File)   = OHL
>
> Number of groups in file (modulo) = 740972
>
> Dynamic hashing, hash type= 0
>
> Split/Merge type  = KEYONLY
>
> Block size= 4096
>
> File has 455028 groups in level one overflow.
>
> Number of records = 4835502
>
> Total number of bytes = 3100999567
>
>
>
> Average number of records per group   = 6.5
>
> Standard deviation from average   = 2.4
>
> Average number of bytes per group = 4185.0
>
> Standard deviation from average   = 1856.2
>
>
>
> Average number of bytes in a record   = 641.3
>
> Average number of bytes in record ID  = 14.8
>
> Standard deviation from average   = 283.6
>
> Minimum number of bytes in a record   = 133
>
> Maximum number of bytes in a record   = 8622
>
>
>
> Minimum number of fields in a record  = 110
>
> Maximum number of fields in a record  = 334
>
> Average number of fields per record   = 218.3
>
> Standard deviation from average   = 47.9
>
> File has 2 over files, 3 prime files
>
>
>
> Sincerely,
>
> David Laansma
>
> IT Manager
>
> Hubbard Supply Co.
>
> Direct: 810-342-7143
>
> Office: 810-234-8681
>
> Fax: 810-234-6142
>
> www.hubbardsupply.com<http://www.hubbardsupply.com>
>
> "Delivering Products, Services and Innovative Solutions"
>
>
>
> ___
> U2-Users mailing list
> U2-Users@listserver.u2ug.org
> http://listserver.u2ug.org/mailman/listinfo/u2-users
>

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] Can of worms FILE.STATUS

2012-06-20 Thread Mecki Foerthmann 

Nothing really -  less than 10% overflow is not too bad.
I would have chosen a smaller block size though.

On 20/06/2012 17:20, Dave Laansma wrote:

I have my thoughts already in place but I'd like to hear input on this.
What is wrong with this file?



File name(Dynamic File)   = OHL

Number of groups in file (modulo) = 740972

Dynamic hashing, hash type= 0

Split/Merge type  = KEYONLY

Block size= 4096

File has 455028 groups in level one overflow.

Number of records = 4835502

Total number of bytes = 3100999567



Average number of records per group   = 6.5

Standard deviation from average   = 2.4

Average number of bytes per group = 4185.0

Standard deviation from average   = 1856.2



Average number of bytes in a record   = 641.3

Average number of bytes in record ID  = 14.8

Standard deviation from average   = 283.6

Minimum number of bytes in a record   = 133

Maximum number of bytes in a record   = 8622



Minimum number of fields in a record  = 110

Maximum number of fields in a record  = 334

Average number of fields per record   = 218.3

Standard deviation from average   = 47.9

File has 2 over files, 3 prime files



Sincerely,

David Laansma

IT Manager

Hubbard Supply Co.

Direct: 810-342-7143

Office: 810-234-8681

Fax: 810-234-6142

www.hubbardsupply.com

"Delivering Products, Services and Innovative Solutions"



___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users



___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users