Re: [users@httpd] Piping logs to a java process : creates multiple processes

[Milind Vaidya]

I had implemented handling of EOF in the code and it was working fine so
far, until one day I see the java process which is supposed to start every
hour is not doing so. It continues to run. There is no  setting change.
Does that mean somehow logrotate is not sending EOF ?

Does httpd has some error as it hangs on to program or copytruncate is not
sending EOF any more ?

Any idea ?

On Mon, Jan 23, 2017 at 4:41 PM, Eric Covener  wrote:

> On Mon, Jan 23, 2017 at 7:36 PM, Milind Vaidya  wrote:
> > When httpd is started it spawns 2 processes and adds one every one hour,
> > keeping all alive
>
>
> Your java program needs to exit when stdin returns EOF.
>
> --
> Eric Covener
> cove...@gmail.com
>
> -
> To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org
> For additional commands, e-mail: users-h...@httpd.apache.org
>
>

Re: [users@httpd] Piping logs to a java process : creates multiple processes

[Milind Vaidya]

I am revisiting this. As per the change suggested I modified the program so
that it returns EOF and it was working fine. Until one day, the program
which is supposed to get restarted by apache every hour (that's when log
file rotates), stopped getting restarted. It is not stuck. It is still
processing the things. But it is just that it has been running for many
days with same pid. I wonder if that will cause some problem. I am actually
storing all the events read by this program somewhere else. Then I need to
compare these with the logrotate which is hourly rotating the error_log
file. Here I find few events missing.

Any pointers for debugging this ?


On Mon, Jan 23, 2017 at 4:41 PM, Eric Covener  wrote:

> On Mon, Jan 23, 2017 at 7:36 PM, Milind Vaidya  wrote:
> > When httpd is started it spawns 2 processes and adds one every one hour,
> > keeping all alive
>
>
> Your java program needs to exit when stdin returns EOF.
>
> --
> Eric Covener
> cove...@gmail.com
>
> -
> To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org
> For additional commands, e-mail: users-h...@httpd.apache.org
>
>

Re: [users@httpd] Piping logs to a java process : creates multiple processes

[Milind Vaidya]

As an extension to this, if I also want to send ssl_error_log to this
program as well, is there any provision to do so ?


This is what I was doing when using manual script to launch the log
consumer.

*tail* *-n0* *-F** /var/log/httpd/error_log /var/log/httpd/ssl_error_log *
*|*

On Mon, Jan 23, 2017 at 5:38 PM, Milind Vaidya  wrote:

> Thanks for prompt reply Eric.
>
> Adding relevant code resolved, the issue of 2 processes at the beginning.
> Let me wait for logrotate to kick in and see over few hours how it behaves.
>
>
>
> On Mon, Jan 23, 2017 at 4:41 PM, Eric Covener  wrote:
>
>> On Mon, Jan 23, 2017 at 7:36 PM, Milind Vaidya  wrote:
>> > When httpd is started it spawns 2 processes and adds one every one hour,
>> > keeping all alive
>>
>>
>> Your java program needs to exit when stdin returns EOF.
>>
>> --
>> Eric Covener
>> cove...@gmail.com
>>
>> -
>> To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org
>> For additional commands, e-mail: users-h...@httpd.apache.org
>>
>>
>

Re: [users@httpd] Piping logs to a java process : creates multiple processes

[Milind Vaidya]

Thanks for prompt reply Eric.

Adding relevant code resolved, the issue of 2 processes at the beginning.
Let me wait for logrotate to kick in and see over few hours how it behaves.



On Mon, Jan 23, 2017 at 4:41 PM, Eric Covener  wrote:

> On Mon, Jan 23, 2017 at 7:36 PM, Milind Vaidya  wrote:
> > When httpd is started it spawns 2 processes and adds one every one hour,
> > keeping all alive
>
>
> Your java program needs to exit when stdin returns EOF.
>
> --
> Eric Covener
> cove...@gmail.com
>
> -
> To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org
> For additional commands, e-mail: users-h...@httpd.apache.org
>
>

Re: [users@httpd] Piping logs to a java process : creates multiple processes

[Eric Covener]

On Mon, Jan 23, 2017 at 7:36 PM, Milind Vaidya  wrote:
> When httpd is started it spawns 2 processes and adds one every one hour,
> keeping all alive


Your java program needs to exit when stdin returns EOF.

-- 
Eric Covener
cove...@gmail.com

-
To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org
For additional commands, e-mail: users-h...@httpd.apache.org

[users@httpd] Piping logs to a java process : creates multiple processes

[Milind Vaidya]

>
> I am writing messages to error_log file as well as sending to std out.
>
> The setting looks like
>
>
> ErrorLog  "| /usr/bin/tee -a /var/log/httpd/error_log |  java -cp 
> producer.jar stdin.producer.StdInProducer /CustomProducer/config.json >> 
> /producer_init.log 2>&1"`
>
>
When httpd is started it spawns 2 processes and adds one every one hour,
keeping all alive

Only other thing happening per hour is rotation of error_log file by
logrotate with copytruncate option (which copies the file data and
truncates original file keeping the file descriptor unchanged )

I also tested it with another program with setting as follows which runs
fine, so what am I doing wrong here ?

ErrorLog  "| /usr/bin/tee -a /var/log/httpd/error_log |
/usr/bin/logger -u /tmp/apache_log.socket"