Thank you Wally. That's what I was looking for, a 'base' line. 1% or even 6% seemed low.
Doesn't splitting basically happen when too many keys are hashed to the same group for KEYONLY hashed files? Sincerely, David Laansma IT Manager Hubbard Supply Co. Direct: 810-342-7143 Office: 810-234-8681 Fax: 810-234-6142 www.hubbardsupply.com "Delivering Products, Services and Innovative Solutions" -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wally Terhune Sent: Friday, June 29, 2012 3:06 PM To: U2 Users List Subject: Re: [U2] Really trying to understand dynamic file sizing I wouldn't go below 10%. You could end up with lots of splitting and very sparsely populated groups. Wally Terhune Technical Support Engineer Rocket Software 4600 South Ulster Street, Suite 1100 **Denver, CO 80237 **USA t: +1 720 475 8055 **e: wterh...@rocketsoftware.com **w: rocketsoftware.com/u2 -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Doug Averch Sent: Friday, June 29, 2012 11:38 AM To: U2 Users List Subject: Re: [U2] Really trying to understand dynamic file sizing Hi Dave: You cannot get any lower than one percent. If you set your block size to 2K that will fix the split problem making about 6%. Your average record size is 1537 which means you will get about one record per block so split by key will be worthless and you will be into Level 2 and/or Level 1 overflow. I have found if you spend a lot of time on one file try to optimize it, then you had 100K worth of records to the file and your work is does not matter. What you want to do is get the file in best shape you can considering growth and usability, then look at this file or all your files in a week or month and see what has happened. Regards, Doug www.u2logic.com "XLr8Resizer for fast resizing" _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
