Re: [U2] UV File doesn't like being sampled?
On 24/05/13 15:57, George Gallen wrote: > In thinking about itI'm not sure, but it seems to increase the selection > speed (considerably). It is a type 30 file, > So possibly the index makes up for a hashing algorithm where the modulo is > too small? And the makeup of > The @ID causing more similar hashing? A type 30 file typically is very well balanced. Bear in mind that UV files store the key with the data in the group (unless the record is "large"). So any unindexed select has to scan the entire file. So an index will speed up any select, simply by reducing massively the amount of i/o required. I guess it acts strange with an index on @ID because such an index needs special code, precisely because it's not indexing a data field... Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
If your record key is comprised of something meaningful you might want to query against it. For example if your key is say STATE: '*': CITY and you want all the records for a given state ... SELECT FILE WITH @ID "FL*]" . Perry -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Friday, May 24, 2013 8:52 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? Maybe I am missing something, but why would you want an index on @ID? JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:18 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Daniel McGrath Sent: Friday, May 24, 2013 10:10 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? George, I checked out system and we have experienced this issue before. Check if you have built an index on @ID. If you have, this is what is causing your issue. Using the NO.INDEX keyword will give you correct results. I don't have an explanation for the behavior. Let us know how it goes. Regards, Dan McGrath Managing Director, U2 Servers Lab Rocket Software -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 7:52 AM To: U2 Users Subject: [U2] UV File doesn't like being sampled? OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? >SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. >>SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. >> This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. ZirMed, Inc. has strict policies regarding the content of e-mail communications, specifically Protected Health Information, any communications containing such material will be returned to the originating party with such advisement noted. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
For this particular file, it only gets modified once a day - and then being perfectly tuned, might shave a couple minutes off the process To updates it. The Selections are done during the day for searching, and the index helps that - so for this particular file, it's fine the way it's working. George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Friday, May 24, 2013 11:06 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? If you are doing it because of performance, I am thinking you need to re-size the file (as you suggested). This will not just impact SELECTS, but any IO. Also keep in mind you are impacting performance just by having the index. All that being said, getting the time to resize is something that can be limited by the nature of your business. Just some points to consider. You know your business better than the rest of us. JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:57 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? In thinking about itI'm not sure, but it seems to increase the selection speed (considerably). It is a type 30 file, So possibly the index makes up for a hashing algorithm where the modulo is too small? And the makeup of The @ID causing more similar hashing? -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Friday, May 24, 2013 10:52 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? Maybe I am missing something, but why would you want an index on @ID? JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:18 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
If you are doing it because of performance, I am thinking you need to re-size the file (as you suggested). This will not just impact SELECTS, but any IO. Also keep in mind you are impacting performance just by having the index. All that being said, getting the time to resize is something that can be limited by the nature of your business. Just some points to consider. You know your business better than the rest of us. JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:57 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? In thinking about itI'm not sure, but it seems to increase the selection speed (considerably). It is a type 30 file, So possibly the index makes up for a hashing algorithm where the modulo is too small? And the makeup of The @ID causing more similar hashing? -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Friday, May 24, 2013 10:52 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? Maybe I am missing something, but why would you want an index on @ID? JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:18 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
In thinking about itI'm not sure, but it seems to increase the selection speed (considerably). It is a type 30 file, So possibly the index makes up for a hashing algorithm where the modulo is too small? And the makeup of The @ID causing more similar hashing? -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Friday, May 24, 2013 10:52 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? Maybe I am missing something, but why would you want an index on @ID? JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:18 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
Maybe I am missing something, but why would you want an index on @ID? JRI -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:18 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Daniel McGrath Sent: Friday, May 24, 2013 10:10 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? George, I checked out system and we have experienced this issue before. Check if you have built an index on @ID. If you have, this is what is causing your issue. Using the NO.INDEX keyword will give you correct results. I don't have an explanation for the behavior. Let us know how it goes. Regards, Dan McGrath Managing Director, U2 Servers Lab Rocket Software -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 7:52 AM To: U2 Users Subject: [U2] UV File doesn't like being sampled? OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? >SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. >>SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. >> This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled? (Work around)
Oka work around that I didn't think would work...but did... 1. COPY VOC SAMPLE to SAMPLE.ORIG 2. CREATE A VOC SAMPLE ENTRY as below >ED VOC SAMPLE 2 lines long. : P 0001: PH 0002: NO.INDEX SAMPLE.ORIG Bottom at line 2. : EX >ED VOC SAMPLE.ORIG 3 lines long. : P 0001: K 0002: 22 0003: SELECT Bottom at line 3. : EX > Now when I used SAMPLE, it will replace it with NO.INDEX SAMPLE.ORIG Seems to work just fine. Now I don't have to remember which files have @ID indexed or not. I just have to do that on each accountOh well. George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 10:18 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Daniel McGrath Sent: Friday, May 24, 2013 10:10 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? George, I checked out system and we have experienced this issue before. Check if you have built an index on @ID. If you have, this is what is causing your issue. Using the NO.INDEX keyword will give you correct results. I don't have an explanation for the behavior. Let us know how it goes. Regards, Dan McGrath Managing Director, U2 Servers Lab Rocket Software -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 7:52 AM To: U2 Users Subject: [U2] UV File doesn't like being sampled? OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? >SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. >>SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. >> This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
YUP. I just isolated it to the index of @ID. I changed the original filename, recreated a new file Copied all the data Copied all the dict And finally, recreated the index (@ID) Testing the sampling on each step, all went well until I recreated the index, then it bombed again. And yes, using the NO.INDEX does fix it. Does working with an active select list de-activate the @ID Index? George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Daniel McGrath Sent: Friday, May 24, 2013 10:10 AM To: U2 Users List Subject: Re: [U2] UV File doesn't like being sampled? George, I checked out system and we have experienced this issue before. Check if you have built an index on @ID. If you have, this is what is causing your issue. Using the NO.INDEX keyword will give you correct results. I don't have an explanation for the behavior. Let us know how it goes. Regards, Dan McGrath Managing Director, U2 Servers Lab Rocket Software -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 7:52 AM To: U2 Users Subject: [U2] UV File doesn't like being sampled? OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? >SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. >>SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. >> This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
George, Does the file have an index on the id? If so, try adding the "NO.INDEX" keyword. I've something similar @ UV10.2.10: -- >SELECT PARTS SAMPLE 2 26417 record(s) selected to SELECT list #0. - >SELECT PARTS SAMPLE 2 NO.INDEX 2 record(s) selected to SELECT list #0. - >DELETE.INDEX PARTS PART_ID Removing index file PART_ID. >SELECT PARTS SAMPLE 2 2 record(s) selected to SELECT list #0. - So I’m guessing that the UniVerse engineers have a glitch and didn’t consider that someone might index the id. This makes sense why SELECT PARTS SAMPLE 2 works if you already have an active select list: the index isn’t used if a select list is active. On 5/24/2013 8:52 AM, George Gallen wrote: OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] UV File doesn't like being sampled?
George, I checked out system and we have experienced this issue before. Check if you have built an index on @ID. If you have, this is what is causing your issue. Using the NO.INDEX keyword will give you correct results. I don't have an explanation for the behavior. Let us know how it goes. Regards, Dan McGrath Managing Director, U2 Servers Lab Rocket Software -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Friday, May 24, 2013 7:52 AM To: U2 Users Subject: [U2] UV File doesn't like being sampled? OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? >SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. >>SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. >> This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
[U2] UV File doesn't like being sampled?
OK. Any Ideas? I have a Type 30 file that if I use the SAMPLE modifier in the SELECT still returns the entire file, However, if I use the SAMPLE modifier in a LIST command on that same file, it only returns the sample amount. Now, it gets stranger, If I do a SELECT with the SAMPLE modifier, it returns the whole file as an active list, and if I Do another SELECT with the SAMPLE modifier on that active list, it only returns the the sample amount. So what, the file is just toying with me? I guess if I really want that sample, I have to ask twice? >SELECT FILENAME SAMPLE 10 929347 record(s) selected to SELECT list #0. >>SELECT FILENAME SAMPLE 10 10 record(s) selected to SELECT list #0. >> This seems to be the only file that is behaving this way. There are no dictionary items in the file that would Interfere with the UV selection. My next step will be to create a new file, and copy over the contents, just in case there is something that Is corrupted in the file. This is on UV 10.0.2 / RH Linux ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
