[U2] Regex searching UD files
I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
I think this should be one for Rocket to implement a RegexSearch in U2. However, if it's size non-impactive, what I would normally do is copy the file to a temporary directory then run grep across that. Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, 29 March 2010 17:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
GCI ! -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: 29 March 2010 07:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] CPU Spikes to 100%
From: Curt Stewart The environment is a virtualized Windows 2003 Server and Universe 10.2.10 On occasion, I've been notified twice, it may have occurred more often, a Universe process (tl_server.exe) will consume 100% of the CPU. Curt, I wasn't watching this tread earlier, sorry. This is the Exact same problem that Mike Roosa at Tolt is having, as documented in another recent thread here. Rocket has been unable to thoroughly diagnose the issue but tl_server does seem to be either the culprit or a telltale victim. I highly recommend you contact Rocket and tell them this may be related to the Tolt situation. Note that their environment is also virtualized in VMware. Perhaps there is something in VMware, like flushing, or some abnormal condition, which causes tl_server to start spinning. Good luck bud. T Tony Gravagno Nebula Research and Development TG@ remove.pleaseNebula-RnD.com remove.pleaseNebula-RnD.com/blog Visit PickWiki.com! Contribute! http://Twitter.com/TonyGravagno ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] CPU Spikes to 100%
I'm very interested in hearing the resolution to this. We are looking at moving our Unidata system to a virtualized server. TIA. Charles Shaffer Senior Analyst NTN-Bower Corporation ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] CPU Spikes to 100%
Thanks Tony, As always that's good advice. I'll be sure to keep the group posted if I make any advances on this. Curt www.tri-sysconsulting.com Real-World Solutions for Real-World Problems! View my LinkedIn R Profile -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Tony Gravagno Sent: Monday, March 29, 2010 12:35 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] CPU Spikes to 100% From: Curt Stewart The environment is a virtualized Windows 2003 Server and Universe 10.2.10 On occasion, I've been notified twice, it may have occurred more often, a Universe process (tl_server.exe) will consume 100% of the CPU. Curt, I wasn't watching this tread earlier, sorry. This is the Exact same problem that Mike Roosa at Tolt is having, as documented in another recent thread here. Rocket has been unable to thoroughly diagnose the issue but tl_server does seem to be either the culprit or a telltale victim. I highly recommend you contact Rocket and tell them this may be related to the Tolt situation. Note that their environment is also virtualized in VMware. Perhaps there is something in VMware, like flushing, or some abnormal condition, which causes tl_server to start spinning. Good luck bud. T Tony Gravagno Nebula Research and Development TG@ remove.pleaseNebula-RnD.com remove.pleaseNebula-RnD.com/blog Visit PickWiki.com! Contribute! http://Twitter.com/TonyGravagno ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
Dan you can't do it because the records in Universe are not files at all, not even logical files. They are just possible frame-discontinous streams of bytes that *Universe* interprets in run-time as a connected record. Nothing else is going to be able to do that, without re-writing the frame(block)-walker directly in Unix. Alternatively you could write egrep in Universe yourself which would probably be easier! But I wouldn't read and write after each record, I would read and write the entire file at *once*. And then egrep. I sure that would save on thrashing at least. If you're processing at least 10 percent of the file, then you might see that writing the whole file, then switching to Unix for the rest will still be faster than breaking after each write. Will Johnson In a message dated 3/28/2010 11:22:25 P.M. Pacific Daylight Time, stuart.boyd...@spotless.com.au writes: I think this should be one for Rocket to implement a RegexSearch in U2. However, if it's size non-impactive, what I would normally do is copy the file to a temporary directory then run grep across that. Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, 29 March 2010 17:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick Pocket Guide [not-secure]
Somewhere in the back of my mind is a little voice saying you can't trademark already existing words That might be wrong, but I'm sure there's a suit about it somewhere. Anyone? Buehler? In a message dated 3/28/2010 3:38:10 P.M. Pacific Daylight Time, j...@jes.com writes: Dick, Bill Walsh and I sat around bouncing around some potential names, since Microdata had a lock on English. Wonder how they went about trademarking that one. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
Does UniData ECL ESEARCH command not fill the bill already? Wally Terhune U2 Support Architect Rocket Software 4700 S. Syracuse Street, Suite 400 **Denver, CO 80237 **USA Tel: +1.720.475.8055 Email: wterh...@rs.com Web: www.rocketsoftware.com/u2 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Boydell, Stuart Sent: Monday, March 29, 2010 12:22 AM To: U2 Users List Subject: Re: [U2] Regex searching UD files I think this should be one for Rocket to implement a RegexSearch in U2. However, if it's size non-impactive, what I would normally do is copy the file to a temporary directory then run grep across that. Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, 29 March 2010 17:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
The Mac Terminal application in OSX works just fine as a VT100 terminal emulator. Run telnet to wherever you want from the command line. fft2...@aol.com wrote: Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users -- Jeff Schasny - Denver, Co, USA jschasny at gmail dot com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
Yes. OpenQM by Ladybridge Systems. http://www.openqm.com ...available on Windows, Linux (Red Hat, Fedora, Debian, Ubuntu), FreeBSD, Mac OS X and Windows Mobile. Best regards, Henry Henry P. Unger Hitech Systems, Inc. http://www.hitech.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of fft2...@aol.com Sent: Monday, March 29, 2010 12:38 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Pick on Mac Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
Will, MacWise by Carnation Software does a very nice job of terminal emulation (including Wyse 50 and Wyse 60) and even has some compatibility with AccuTerm in the area of file transfers. Additionally, it has an FTP client although I have not tried it out yet. -Craig McDonald -Original Message- From: Jeff Schasny [mailto:jscha...@gmail.com] Sent: Monday, March 29, 2010 12:51 PM To: U2 Users List Subject: Re: [U2] Pick on Mac The Mac Terminal application in OSX works just fine as a VT100 terminal emulator. Run telnet to wherever you want from the command line. fft2...@aol.com wrote: Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users -- Jeff Schasny - Denver, Co, USA jschasny at gmail dot com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
I have only used this product (OpenQM) occasionally, but it is amazingly good. Incredibly competent people at Ladybridge I second the suggestion. Regards, Allen On 3/29/2010 3:05 PM, Henry Unger wrote: Yes. OpenQM by Ladybridge Systems. http://www.openqm.com ...available on Windows, Linux (Red Hat, Fedora, Debian, Ubuntu), FreeBSD, Mac OS X and Windows Mobile. Best regards, Henry Henry P. Unger Hitech Systems, Inc. http://www.hitech.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of fft2...@aol.com Sent: Monday, March 29, 2010 12:38 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Pick on Mac Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
I think I saw someone on this list that was using one of the U2 products on Mac OSX or on the Windows virtual emulator. Could be wrong. Jerry Banker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of fft2...@aol.com Sent: Monday, March 29, 2010 2:38 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Pick on Mac Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
Of course the Mac OS's are Unix-based. Thus, in theory, porting UniVerse to the Mac SnowLeopard server should be a relatively easy task. --Bill ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
Intersystems Cache runs on the mac. On Mar 29, 2010, at 3:38 PM, fft2...@aol.com wrote: Are there are native implementations of a Pick system on Macs? Or are all Mac connections just terminal emulators into a Windows/Unix system? I know there is or used to be an emulator by Carnation that rode on a Mac. But have all such implementations been to have it talk with a Pick system living on a Windows or Unix box? Does Universe have any sites where users are connecting using Macs as their PC? Will Johnson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
Not even close... We run in ECLTYPE P and don't have access to EVAL and the like. ^[Cc][Hh][Qq].*[5-8][0-9][0-9][0-9]x Unless you can explain how to duplicate the above search with ESEARCH? @Stuart, that would be ideal, but unfortunately I can't go dumping out multi-gigabyte files. :( -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wally Terhune Sent: Tuesday, 30 March 2010 5:22 AM To: U2 Users List Subject: Re: [U2] Regex searching UD files Does UniData ECL ESEARCH command not fill the bill already? Wally Terhune U2 Support Architect Rocket Software 4700 S. Syracuse Street, Suite 400 **Denver, CO 80237 **USA Tel: +1.720.475.8055 Email: wterh...@rs.com Web: www.rocketsoftware.com/u2 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Boydell, Stuart Sent: Monday, March 29, 2010 12:22 AM To: U2 Users List Subject: Re: [U2] Regex searching UD files I think this should be one for Rocket to implement a RegexSearch in U2. However, if it's size non-impactive, what I would normally do is copy the file to a temporary directory then run grep across that. Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, 29 March 2010 17:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email __ ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] CPU Spikes to 100%
In message 10998-1269884106-801...@sneakemail.com, Tony Gravagno 3xk547...@sneakemail.com writes From: Curt Stewart The environment is a virtualized Windows 2003 Server and Universe 10.2.10 On occasion, I've been notified twice, it may have occurred more often, a Universe process (tl_server.exe) will consume 100% of the CPU. Curt, I wasn't watching this tread earlier, sorry. This is the Exact same problem that Mike Roosa at Tolt is having, as documented in another recent thread here. Rocket has been unable to thoroughly diagnose the issue but tl_server does seem to be either the culprit or a telltale victim. I highly recommend you contact Rocket and tell them this may be related to the Tolt situation. Note that their environment is also virtualized in VMware. Perhaps there is something in VMware, like flushing, or some abnormal condition, which causes tl_server to start spinning. Ahhh! This sounds like a long-standing problem that I thought had been fixed some while back. We used to suffer this with UV9.6 on NT but I don't remember it with UV10/Win2K. We didn't have a virtualised environment at the time, so if it's the problem we had, it's nothing to do with VMware. Cheers, Wol -- Anthony W. Youngman pi...@thewolery.demon.co.uk 'Yings, yow graley yin! Suz ae rikt dheu,' said the blue man, taking the thimble. 'What *is* he?' said Magrat. 'They're gnomes,' said Nanny. The man lowered the thimble. 'Pictsies!' Carpe Jugulum, Terry Pratchett 1998 Visit the MaVerick web-site - http://www.maverick-dbms.org Open Source Pick ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
Hi Will, Are there are native implementations of a Pick system on Macs? As Henry and Allen have both said, our OpenQM product runs on Macs. We have installations ranging from MacBook Pro laptops right through to Mac Servers. Since your query is raised on the U2 list, it is fair to say that, of course, QM is not U2 however migration should be very easy if you want to go down this route. There is an evaluation version available. Probably any further discussion should be via the OpenQM Google group rather than here. Martin Phillips Ladybridge Systems Ltd 17b Coldstream Lane, Hardingstone, Northampton, NN4 6DB +44-(0)1604-709200 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
Thanks for the reply Will, but I do understand how U2 files work. That's why I'm using UniBasic to read the record then write it out to UNIX. If the files we search weren't so big I would just dump a copy to a dir than search it, but that isn't practical in most cases for us. Maybe I can improve it to write the records in blocks of 'x', search them. That would at least save some of the processing cost of jumping around, but it doesn't solve the Disk I/O bottleneck. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of fft2...@aol.com Sent: Tuesday, 30 March 2010 5:14 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Regex searching UD files Dan you can't do it because the records in Universe are not files at all, not even logical files. They are just possible frame-discontinous streams of bytes that *Universe* interprets in run-time as a connected record. Nothing else is going to be able to do that, without re-writing the frame(block)-walker directly in Unix. Alternatively you could write egrep in Universe yourself which would probably be easier! But I wouldn't read and write after each record, I would read and write the entire file at *once*. And then egrep. I sure that would save on thrashing at least. If you're processing at least 10 percent of the file, then you might see that writing the whole file, then switching to Unix for the rest will still be faster than breaking after each write. Will Johnson In a message dated 3/28/2010 11:22:25 P.M. Pacific Daylight Time, stuart.boyd...@spotless.com.au writes: I think this should be one for Rocket to implement a RegexSearch in U2. However, if it's size non-impactive, what I would normally do is copy the file to a temporary directory then run grep across that. Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, 29 March 2010 17:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email __ ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the
[U2] ECLTYPE U mode [was RE: Regex searching UD files]
Regarding your ECLTYPE P comment... Any application has access to ECLTYPE U and associated features. If you use the lowercase version of any standard ECL verb - U mode parsing is forced. Wally Terhune U2 Support Architect Rocket Software 4700 S. Syracuse Street, Suite 400 **Denver, CO 80237 **USA Tel: +1.720.475.8055 Email: wterh...@rs.com Web: www.rocketsoftware.com/u2 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, March 29, 2010 3:13 PM To: U2 Users List Subject: Re: [U2] Regex searching UD files Not even close... We run in ECLTYPE P and don't have access to EVAL and the like. ^[Cc][Hh][Qq].*[5-8][0-9][0-9][0-9]x Unless you can explain how to duplicate the above search with ESEARCH? @Stuart, that would be ideal, but unfortunately I can't go dumping out multi-gigabyte files. :( ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] ECLTYPE U mode [was RE: Regex searching UD files]
Interesting! Is that in the manuals? I don't recall coming across it... -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wally Terhune Sent: Tuesday, 30 March 2010 8:57 AM To: U2 Users List Subject: [U2] ECLTYPE U mode [was RE: Regex searching UD files] Regarding your ECLTYPE P comment... Any application has access to ECLTYPE U and associated features. If you use the lowercase version of any standard ECL verb - U mode parsing is forced. Wally Terhune U2 Support Architect Rocket Software 4700 S. Syracuse Street, Suite 400 **Denver, CO 80237 **USA Tel: +1.720.475.8055 Email: wterh...@rs.com Web: www.rocketsoftware.com/u2 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, March 29, 2010 3:13 PM To: U2 Users List Subject: Re: [U2] Regex searching UD files Not even close... We run in ECLTYPE P and don't have access to EVAL and the like. ^[Cc][Hh][Qq].*[5-8][0-9][0-9][0-9]x Unless you can explain how to duplicate the above search with ESEARCH? @Stuart, that would be ideal, but unfortunately I can't go dumping out multi-gigabyte files. :( ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email __ ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] ECLTYPE U mode [was RE: Regex searching UD files]
Here is one that isn't documented (for sure) - since PROC is supported but not documented. If you use PU instead of P, the command is run in U mode... :-) Wally Terhune U2 Support Architect Rocket Software 4700 S. Syracuse Street, Suite 400 **Denver, CO 80237 **USA Tel: +1.720.475.8055 Email: wterh...@rs.com Web: www.rocketsoftware.com/u2 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, March 29, 2010 4:12 PM To: U2 Users List Subject: Re: [U2] ECLTYPE U mode [was RE: Regex searching UD files] Interesting! Is that in the manuals? I don't recall coming across it... -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wally Terhune Sent: Tuesday, 30 March 2010 8:57 AM To: U2 Users List Subject: [U2] ECLTYPE U mode [was RE: Regex searching UD files] Regarding your ECLTYPE P comment... Any application has access to ECLTYPE U and associated features. If you use the lowercase version of any standard ECL verb - U mode parsing is forced. Wally Terhune U2 Support Architect Rocket Software 4700 S. Syracuse Street, Suite 400 **Denver, CO 80237 **USA Tel: +1.720.475.8055 Email: wterh...@rs.com Web: www.rocketsoftware.com/u2 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, March 29, 2010 3:13 PM To: U2 Users List Subject: Re: [U2] Regex searching UD files Not even close... We run in ECLTYPE P and don't have access to EVAL and the like. ^[Cc][Hh][Qq].*[5-8][0-9][0-9][0-9]x Unless you can explain how to duplicate the above search with ESEARCH? @Stuart, that would be ideal, but unfortunately I can't go dumping out multi-gigabyte files. :( ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email __ ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Regex searching UD files
I don't know what the UD hashed files look like under the hood, and I haven't tried it but with a UV hashed files it might just be possible to pass the whole thing through sed or awk first to convert system marks to CR and parse out the ID and searched for text using grep. Just a thought. Good luck, Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Tuesday, 30 March 2010 08:50 To: U2 Users List Subject: Re: [U2] Regex searching UD files Thanks for the reply Will, but I do understand how U2 files work. That's why I'm using UniBasic to read the record then write it out to UNIX. If the files we search weren't so big I would just dump a copy to a dir than search it, but that isn't practical in most cases for us. Maybe I can improve it to write the records in blocks of 'x', search them. That would at least save some of the processing cost of jumping around, but it doesn't solve the Disk I/O bottleneck. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of fft2...@aol.com Sent: Tuesday, 30 March 2010 5:14 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Regex searching UD files Dan you can't do it because the records in Universe are not files at all, not even logical files. They are just possible frame-discontinous streams of bytes that *Universe* interprets in run-time as a connected record. Nothing else is going to be able to do that, without re-writing the frame(block)-walker directly in Unix. Alternatively you could write egrep in Universe yourself which would probably be easier! But I wouldn't read and write after each record, I would read and write the entire file at *once*. And then egrep. I sure that would save on thrashing at least. If you're processing at least 10 percent of the file, then you might see that writing the whole file, then switching to Unix for the rest will still be faster than breaking after each write. Will Johnson In a message dated 3/28/2010 11:22:25 P.M. Pacific Daylight Time, stuart.boyd...@spotless.com.au writes: I think this should be one for Rocket to implement a RegexSearch in U2. However, if it's size non-impactive, what I would normally do is copy the file to a temporary directory then run grep across that. Stuart Boydell -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, 29 March 2010 17:08 To: U2 Users List Subject: [U2] Regex searching UD files I've written a small utility to be able to run egrep on a UD file (not UD directory), however its implementation is not ideal. Essentially, I select the file I'm searching, writing each record one at a time to a temp UNIX file and running egrep on it as follows !egrep -q -f MyTempRegexFile MyTempRecordFile ; echo $? Where MyTempRegexFile is a file containing the desired regex pattern stored earlier and MyTempRecordFile is a file name unique to each user. My problem with it is that I have to do a READ on each record, followed by a WRITE then have egrep read it in as well. That's a lot of seemingly unneeded disk IO if I could only stream the record to egrep without have to do a WRITE after the READ. Any ideas? I feel I'm missing something quite obvious. Regards, Dan ### The information transmitted in this message and attachments (if any) is intended only for the person or entity to which it is addressed. The message may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. The intended recipient of this e-mail may only use, reproduce, disclose or distribute the information contained in this e-mail and any attached files with the permission of IMB. ### ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users __ This email has been scanned by the MessageLabs Email Security System. For more information please visit
Re: [U2] ECLTYPE U mode [was RE: Regex searching UD files]
You can write the equivalent of the egrep command in Pick basic that you could call from the TCL. If you need a working example to write (to see what command line options are normally supported), it there are a number of versions of grep/cgrep/egrep/fgrep on freshmeat.net. Most likely written in C or C++. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan McGrath Sent: Monday, March 29, 2010 3:13 PM To: U2 Users List Subject: Re: [U2] Regex searching UD files Not even close... We run in ECLTYPE P and don't have access to EVAL and the like. ^[Cc][Hh][Qq].*[5-8][0-9][0-9][0-9]x Unless you can explain how to duplicate the above search with ESEARCH? @Stuart, that would be ideal, but unfortunately I can't go dumping out multi-gigabyte files. :( ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Pick on Mac
If there is no build for Mac OS, U2 runs on Linux and there are Linux versions that can be installed on a Mac so it might work. If you're talking about a virtual environment, then no problem. But as to installing into Mac itself? It's a funny world we live in where people tend to assume that it's a fairly easy effort to port an application from one operating system to another. Hey, they all end in X, right? I'd really love to hear from the people at Rocket who actually work at this level, to find out just how deep Universe and/or Unidata are coded into specific *nix OS's. If there are loose bindings, and paths are all set via configuration files, then sure, a port may not be a major deal. But if they're doing platform-specific file IO or networking, or doing anything specific with memory, or relying on hooks in GCC or build tools which are not quite the same across platforms (and I strongly suspect this is the case) then porting across platforms is absolutely not as simple as people here would imagine. Tony Gravagno Nebula Research and Development TG@ remove.pleaseNebula-RnD.com remove.pleaseNebula-RnD.com/blog Visit PickWiki.com! Contribute! http://Twitter.com/TonyGravagno ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
