nfs permissions
Hi all, My application is running on one host(local) and integrate with another application that runs on another host(remote). during its work the two applications are using the a NFS shared folder from my application, doing some processing on some of the files there and save it there. Im using umask 022. In order that the remote user will be able to have a write access, I added it on the remote machine to the same group of the user my application is runnig on the local machine(I first created it with the same name on both machines). But I still exprencing a problem to get a write permission on the shred folder from the remote user. Thanks Yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
tcpdump
I would like to monitor all TCP/UDP activities on certain ports. The ports are in LISTEN state (checked by netstat). So when I type: tcpdump port 7028 and tcpdump port 9000 I can see the activity only on 9000 as port 9000 gets requests form outside the local host. Is there any way to trace the tcp activity in the local host? Yahav Biran Mobilitec, Inc * [EMAIL PROTECTED] (+972 4813 8020 Ext: 2517 Fax:+972 4 813 8022
swap in Linux
My application does from time to time swap. I can see it by monitoring it with vmstat command (si and so parameters). I would like to know why this swap activity was made (lack of memory or memory algorithm). Another question: it looks that the java processes are spawned to many java processes, how one can monitor it. I tried to top the processes and then use ps -H but the process is disappearing until I catch it. = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
RE: swap in Linux
On Sun, Nov 05, 2006 at 12:28:41PM +0200, Yahav Biran wrote: My application does from time to time swap. I can see it by monitoring it with vmstat command (si and so parameters). I would like to know why this swap activity was made (lack of memory or memory algorithm). If swap is used it's because there's a memory shortage, so I don't quite understand the question. [Yahav Biran] I thought that a page can be flush to the disk if nobody is using it for certain amount of time. In Solaris a page fault can happen not only when you are lack of memory. Solaris allocate all its free memory to a process buffer. Another question: it looks that the java processes are spawned to many java processes, how one can monitor it. I tried to top the processes and then use ps -H but the process is disappearing until I catch it. How short lived is the process? can you modify its code or execution enviroment? [Yahav Biran] I don't think I can, is there any way to take a process tree snapshot like ps -H. When viewing the top results, I can see few processes (java) that I own them. When I ps -H it it's already gone. Am I missing something? yahav Cheers, Muli = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
RE: swap in Linux
No question on this issue. Regards the spawned sub process, is there a way to view the tree of the process, like ptree in solaris? -Original Message- From: Muli Ben-Yehuda [mailto:[EMAIL PROTECTED] Sent: Sunday, November 05, 2006 1:29 PM To: Yahav Biran Cc: 'Linux-IL' Subject: Re: swap in Linux On Sun, Nov 05, 2006 at 01:19:29PM +0200, Yahav Biran wrote: [Yahav Biran] I thought that a page can be flush to the disk if nobody is using it for certain amount of time. In Solaris a page fault can happen not only when you are lack of memory. Solaris allocate all its free memory to a process buffer. Ok, I understand the question now. Linux will always use all available memory, but it might prefer to replace an unused page with a page used for caching, for example. I don't know off the top of my head if there's a way to distinguish between the cases of replacing a page by another process page and replacing it by a cache page. What is the underline question? Cheers, Muli = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
RE: swap in Linux
On 05/11/06, Yahav Biran [EMAIL PROTECTED] wrote: Another question: it looks that the java processes are spawned to many java processes, how one can monitor it. I tried to top the processes and then use ps -H but the process is disappearing until I catch it. Java uses lots of threads - for a start the Garbage Collector (GC) runs in its own thread. And that's even before you start writing real Java programs which are encouraged by the language to use multi-threading. What kernel version are you using? [Yahav Biran] 2.6.9-22.0.2 In LinuxThreads (up to 2.4) each thread has its own PID (actually it's an ugly hack using the internal mechanisms of fork(2) but leaving the virtual memory shared among the kids, somewhat reminiscent of BSD's vfork(2)), under 2.6 and its support for proper POSIX threads, all threads appear to belong to the same process (have the same PID) and will only be displayed by ps(1) using -L (for instance), showing the LWP (Light Weight Process). They are listed under /proc/pid/task/tid. That (better thread support) is one of the best reasons to upgrade to 2.6 if you can and haven't done this yet, IMNSHO. If these threads appear and disappear too quickly then maybe there is a place for tuning here - by means of controlling the thread pool parameters (if possible). There are quite a few -X undocumented command line options for the Java VM which will allow you to trace thread creation and possibly influence thread management. RTFM java(1) and dig the net. BTW - which JVM are you using? [Yahav Biran] 1.4.2 Try to find which type of threads it uses. --Amos = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
monitoring native heap size on 2.4
In solaris OS, pmap -x pid | grep heap gives the size of the native heap of the process. I tried to do it in linux and no heap entry, is there any way to monitor the size of the native heap of a process? Yahav Biran Mobilitec, Inc * [EMAIL PROTECTED] (+972 4813 8020 Ext: 2517 Fax:+972 4 813 8022 = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
greek fonts library
hi, part of our application, runs Weblogic application server that generating JSPs and accessing oracle database. in one of the production sites (in Greece) i see that the following library was loaded: /usr/lib/locale/el_GR.ISO8859-7/el_GR.ISO8859-7.so.2 i know that it's some Greek fonts. is somebody ever work with this lib? i tried to install Greek fonts but this library was not loaded. BTW, the application is running on Solaris :) yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: greek fonts library
thanks danny, i did contact sun and bea support. im waiting three weeks allready :) so i thought you guys can help. thanks yahav - Original Message - From: Danny L [EMAIL PROTECTED] Date: Wednesday, October 18, 2006 10:32 Subject: Re: greek fonts library To: yahav biran [EMAIL PROTECTED] Cc: Linux-IL Mailing List linux-il@linux.org.il Yahav Since you are running a proprietary closed source system like Weblogics and Solaris, I suggest you call their customer support. Sun and Weblogics both told me that their customer support is their key differentiator and competitive advantage over Open Source in the telecom service provider market in order to ensure high availability of mission critical systems. God - I love the way those buzz-words just roll off my keyboard. Best regards and good luck - this is a Linux/FOSS forumsorry if you think I'm a snob but I had a similar problem with the Sun Java application server a few years ago and it took Sun 3 months to admit they didnt know the answer Danny yahav biran wrote: hi, part of our application, runs Weblogic application server that generating JSPs and accessing oracle database. in one of the production sites (in Greece) i see that the following library was loaded: /usr/lib/locale/el_GR.ISO8859-7/el_GR.ISO8859-7.so.2 i know that it's some Greek fonts. is somebody ever work with this lib? i tried to install Greek fonts but this library was not loaded. BTW, the application is running on Solaris :) yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED] -- Danny Lieberman http://www.software.co.il/blog - Better Software, music and mountain biking http://www.opensolutions.co.il - Practical, vendor-neutral solutions to reduce operational risk Office + 972 3 610-9750 Cell + 972 54 447-1114 = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
RE: memory leak in Solaris process
Thanks Rami, I would like to emphasis that we are sure that the JVM heap is not leaking as we monitored it (simply by invoking the java process with -verbosegc option). My problem is the OS (unix) heap process. When you invoke the process map: 29753: /export/home/mpowerv5/jdk/bin/java -server -mx1024m -ms512m -XX:+Aggre 0001 40K read/exec /export/home/mpowerv5/jdk/bin/java 00028000 8K read/write/exec /export/home/mpowerv5/jdk/bin/java 0002A000 142920K read/write/exec [ heap ] A7878000 32K read/write/exec [ anon ] A7978000 32K read/write/exec [ anon ] You can see the [ heap ] size 142920K. this number is increasing endlessly. I would like to know what it contain. Did anybody look for such memory leak? Thanks yahav -Original Message- From: Rami Rosen [mailto:[EMAIL PROTECTED] Sent: Thursday, October 12, 2006 9:55 AM To: Yahav Biran Cc: Linux-IL Subject: Re: memory leak in Solaris process Yahav, I have to admit my sin in doing some kernel programming and user space development recently in open solaris . In fact, some of it is porting from linux to solaris which even may sound worth in this mailing list... Solaris is known for it's dynamic tracing functionality, also known as DTrace. You can also use DTrace with java prcoesses on solaris. Please take a look at https://solaris10-dtrace-vm-agents.dev.java.net You should act according to the java version you have and the instructions there. I had Java HotSpot(TM) Server VM (build 1.5.0_07-b03, mixed mode). So I had to download dvm.zip and install it and configure it according to the instructions there. Running dtrace on a java process is simple: After installing dvm, run the java process like this: java -Xrundvmti:all SendCmdLoop then find out your processId run: dtrace -n'dvmProcessId:::' -p ProcessId thats it: you get many messages, like track_allocation:object-alloc, _method_exit:method-return and more. you can also activate DTrace with less probes (instead of -Xrundvmti:all). You may want also to look at the DTrace manual , which is quite long. In case you have a Mustang ( java 6/jdk 1.6 prerelease) the provider is different is a bit different, see in that web site. There is a syscall and signales tracker utility which is built in in solaris called truss. It may aslo help you. Activation is simple: truss -p processId. Hope this helps. Regards, Rami Rosen On 10/11/06, Yahav Biran [EMAIL PROTECTED] wrote: Hi, I'm running an instance of Weblogic on Solaris 8. when I monitoring the process resource usage using prstat I can see that it after a week the RSS size is growing until the service is really bad and then I restart the application. The application is a web application that connected to oracle DB using OCI client. When I view the process map (pmap PID) I can see that the size of the (UNIX process)heap is growing. BUT when I monitoring the memory usage in the JVM I can see that there is no memory leak as no OutOfMemoryError is arising from the GC. i would like to have a way to monitor the usage of the UNIX process heap. I any body knows on such utility? Thanks yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED] = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
memory leak in Solaris process
Hi, I'm running an instance of Weblogic on Solaris 8. when I monitoring the process resource usage using prstat I can see that it after a week the RSS size is growing until the service is really bad and then I restart the application. The application is a web application that connected to oracle DB using OCI client. When I view the process map (pmap PID) I can see that the size of the (UNIX process)heap is growing. BUT when I monitoring the memory usage in the JVM I can see that there is no memory leak as no OutOfMemoryError is arising from the GC. i would like to have a way to monitor the usage of the UNIX process heap. I any body knows on such utility? Thanks yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
netstat info
Hi, An instance of Apache is configured to listen on certain port, (9010 in my case). When I want to know if it listens, I used the netstat utility and grep the 9010 lines. I saw two lines with the listen state. When looking what tables these lines belongs I discover that one listen belongs to TCP: IPv6 and other to TCP: IPv4. I want to believe that this is the same process that listens on the same port. Our application use only the IPv4, is it possible to disable the apache IPv6 module? The IPv5 module is down (ifconfig -a6) so I guess it is the apache configuration. Thanks yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Text processing
--Boundary_(ID_YbYC/BOeQA7s7drw4FDshA) Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Hi, I'm trying to analyze a CSV file that was converted from xls file. It contains weird characters. I had lots of '\n' characters that were interrupting the parsing but I still left with other that looks like end of line but they are not (it do not changed with tr nor sed). In any case I attached two lines from the file. --Boundary_(ID_YbYC/BOeQA7s7drw4FDshA) Content-type: application/vnd.ms-excel; name=audio.csv Content-transfer-encoding: quoted-printable Content-disposition: attachment; filename=audio.csv 305054,In My = Memory,,90,1700,29266,,,content_upload/obox/700/29266/InMyMemory.wma,,OBO= X_MP3,Blackhole_??? = ???_RS50%;GMI_??_RS10%,3G,download,mp3,LG/U8120/;MOT-E1000/;LG/U8= 330/;MOT-RAZRV3x/;/conts/700/29266/305054/inmymemmory.mp3= ,,ORANGE \Content Tree \? ?? \? ? LG - 3G\200 albums = \??? ?? ??? ? \??? = ???;/Channels/3gorange/music/artists/Dr_Kasper/ = _NOKIA6280,??? ,700,29266,LG - mp3,RTONE,??? ??? ,38727.9103 305053,Flight = 643,,90,1700,29265,,,content_upload/obox/700/29265/Flight643.wma,,OBOX_MP= 3,Blackhole_??? = ???_RS50%;GMI_??_RS10%,3G,download,mp3,LG/U8120/;MOT-E1000/;LG/U8= 330/;MOT-RAZRV3x/;/conts/700/29265/305053/flight643.mp3,,= ORANGE \Content Tree \? ?? \? ? LG - 3G\200 albums \??? = ?? ??? ? \?? = ;/Channels/3gorange/music/artists/Dr_Kasper/ _NOKIA6280,??? = ,700,29265,LG - mp3,RTONE,?? ,38727.9103 --Boundary_(ID_YbYC/BOeQA7s7drw4FDshA)-- = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
good book in tcsh shell programming.
Hi, Does any body know a good book with examples for learning tcsh. I would like to learn the benefits of using it by scripting such as: variables and arithmetic, looping, functions and other stuff. Thanks yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
convert Microsoft Excel xls To CSV
It's nightmare to process an xls file. An external system is generating it and I need to process it. Is there any way to convert Microsoft Excel xls To CSV using a shell script. Is there any linux util that can help? thanks = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
converting date to utc
When analyzing an apache access log I need to convert a date with the format: [24/May/2006:01:20:22 to a utc time (I need to calculate hits per minutes). I would like to know if there is a quick way to convert the date string. I tried to do it date -s STRING but it keeps telling me that it's invalid format. I can convert it to whatever format but how can I know what format needed. The man page does not specify this point. Thanks yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
key-based authentication over SSH
Hi all, I'm trying to configure two machines with key based authentication. In the client machine: First I created my private and public key: ssh-keygen -b 1024 -f identity -P '' -t dsa In result, the public key file, identity.bup and the private key file, identity were created. Transfer the public key to the server. In the server machine: Create the directory ~user/.ssh Add the public key into the authorized_keys file under the .ssh directory. Back to the client: Login to the server using the private key: ssh {server ip} -i identity it still ask for password. Why Thanks yahav --- = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
RE: key-based authentication over SSH
Many thanks it is working now. -Original Message- From: Ilya Konstantinov [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 27, 2006 3:59 PM To: yahav Biran Cc: 'IL Linux' Subject: Re: key-based authentication over SSH yahav Biran wrote: Add the public key into the authorized_keys file under the .ssh directory. Back to the client: Login to the server using the private key: ssh {server ip} -i identity it still ask for password. Why Plenty of possible reasons, but the most common one is incorrect permissions on the ~/.ssh directory or the ~/.ssh/authorized_keys file. If you have root access to the server, you will see the reason in the logs. Otherwise, just do: chmod 700 ~/.ssh chmod 600 ~/.ssh/authorized_keys = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Unix schedulers
Hi all, I have a shell script that need to be run in a configurable duration. The duration shall be read from a configuration server (simple apache server). Now, I need a scheduler that will read this configuration and will execute it. Crontab is not an option since I don't get crontab access in the machines that my application is running. I thought on a simple script that will be in infinite loop and every fix time will wake up and execute the relevant script. Is there any other unix scheduler that can run on linux and solaris? Is any body have another idea? Thanks yahav = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
pid by port number
Hi all, Is somebody knows how can I retrieved the pid that holds a port. In solaris I'm using the pfiles. Many thanks [Yahav Biran] = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]