Re: [APE Project] APE Server performance test and Logs

Fri, 29 Jan 2010 03:26:52 -0800 

Hi,
if you want the output of Ape.log to go to stdout just don't run APE as a daemon (edit ape.conf and set daemon to no). With APE 1.0 Ape.log is not written to log file, this has been fixed on github version. 

Regards.

Teguh Eko Budiarto a écrit :

Hi Guys, 

Yesterday tests was not very satisfying. The server stuck three times 
already before it finished the 8,000th iteration, and I decided to 
stop and change the approach.



Currently, I am trying to modify the inlinepush command to add the 
logging. 
However the it seems that Ape.log doesn't put anything in the log file.

Where can I see the log output?


I called inlinepush command directly through multi threaded python 
module, but there was no log even with the Ape.log inside the command 
module. Is this a bug? 


Best Regards,
Teguh Eko Budiarto
System - Development Team
Brastel Co., Ltd.
+81 (3) 5637-5393



On Thu, Jan 28, 2010 at 6:25 PM, Teguh Eko Budiarto 
<[email protected] <mailto:[email protected]>> wrote:


    Hi Daniel,

    I am using erlang to do the http request to the php file coming
    from the Controller Demo.
    I only created a simple loop which does multiple http request
    which also actually a loop.
    each http request will wait the previous to be finished and got
    response before start.
    after a multiple request loop finished, it will sleep for some
    interval then start another multiple request loop.

    From yesterday, I was testing by executed 10,000 loop for 5000
    requests each and sleeping 5 seconds for each loop.
    it already stopped twice, meaning just halt without any
    information/response from the server side.

    first one stopped at loop number #4295, request number 2000
    something. I just stop and start again the APE server, and the
    loop continues.

    the second one stopped at loop #4476, request number 2917. I
    noticed some movements, but very slow. The memory seems bloated to
    704MB

    The erlang program and ape server are running in different machines.

    Let me know if you want to know more details. Thanks.


    Best Regards,
    Teguh Eko Budiarto
    System - Development Team
    Brastel Co., Ltd.
    +81 (3) 5637-5393


    On Thu, Jan 28, 2010 at 6:02 PM, D. Dahlke <[email protected]
    <mailto:[email protected]>> wrote:

        Hi Teguh Eko Budiarto,

        i would like to know how is your performance test environment
        excactly.
        Whihc tools do you use to connect to ape and stay connected as
        the web browser does?

        regards,
        daniel


        Am 27.01.2010 14:58, schrieb Teguh Eko Budiarto:

        Hi Anthony,

        I look at your suggestion to fine tune the kernel, but that's
        not where I am going right now.

        I was experiencing request (only from 1 connection) without
        any response, but did not know what was going on. Last time I
        was running loop for 100,000 simple messages sending to the
        server from 1 connection and it was ok the first time, but

        the second time it was broke at 30,000 something. 


        Currently I am running more tests with 10,000 loop of 5000
        messages using 1 connection for each 5 seconds intervals, I
        hope it will be ok until it finished.

        I really would like to know what happened in the server if it
        stuck again and maybe find some way to fix/solve it. Is there
        any plans to make the logs from the APE server more verbose?

        Best Regards,
        Teguh Eko Budiarto



        On Mon, Jan 25, 2010 at 10:48 PM, Anthony Catel
        <[email protected] <mailto:[email protected]>> wrote:



            Hi, 


            Thanks a lot for your quick answer.

            - What version are you currently stressing? (1.0 or the
            github version)
            I was using the 1.0, currently based on <efyx>
            suggestion from irc, I am currently testing the github
            version and can send 30,000 messages at a time. After
            that, I want to test the concurrency with a lots of user
            test. Thanks

            You should try the 1.01dev (github). Btw what transport
            your clients are using? (long polling, xhrstreaming, other?)




            - Did you enabled spidermonkey module?
            I haven't, should I ?

            If you don't need it, no :)



            I will take a look on the tune hints you suggested. I
            will let you know my updates.

            Cheers,
            Teguh Eko Budiarto


            On Mon, Jan 25, 2010 at 10:15 PM, Anthony Catel
            <[email protected] <mailto:[email protected]>> wrote:

                Hi,

                - What version are you currently stressing? (1.0 or
                the github version)
                - Did you enabled spidermonkey module?

                Indeed, there is some value to tune on your kernel
                such as :

                - /proc/sys/net/core/somaxconn
                - /proc/sys/net/netfilter/nf_conntrack_max
                - /proc/sys/net/ipv4/tcp_*

                You may also look at the rlimit_nofile value in
                ape.conf)

                Please let me know if you find other value to tune ;)

                Anthony C.

                Le 25/01/10 14:07, Teguh Eko a écrit :

                Hi,

                I was doing some load test to the ape-server using a Core2 Quad 
Q9505
                2.83GHz machine with 4GB of memory.

                When I did until 5000 requests at a time, it was fine. But, 
when I did
                for 8000 requests at a time, the server stopped to responding, 
even
                though my CPU load was still at 25% of full capacity. When I 
check the
                APE server status also was still online (OK).

                When I checked the log, there was no explanation about what 
happened
                to the server. It only logged the incoming request I just 
restarted
                the server and it can start to receive new requests again. 
Previous
                requests was gone.

                The questions are:
                1. How do we calculate the server capacity for the maximum 
loads it
                can handle?

                2. APE claims can handle up to 100,000 requests in single 
machine, but
                for mine it started to to get stuck only with 8000 requests. 
Did I
                need to do some tuning in the settings? in which file do I need 
to set
                the settings?

                3. Log file of APE doesn't explain any information related to 
the
                server error, is there any settings need to be change to make it
                produce more detailed log?

                Cheers,


                additional info: below are the log content (/var/log/ape.log)
                2010-01-22 15:27:29 - src/entry.c:183 - APE starting up - pid : 
21837
                2010-01-22 15:27:29 - src/entry.c:242 - Starting daemon
                2010-01-22 15:28:07 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 15:28:15 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 15:28:38 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 15:41:12 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 15:44:18 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 15:44:50 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 15:49:53 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 15:55:29 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 15:55:39 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 16:38:52 - src/users.c:180 - New user - (ip : 
192.168.4.40)
                2010-01-22 18:44:27 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:46:33 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:47:04 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:47:36 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:47:45 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:47:46 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:47:47 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:47:57 - src/users.c:180 - New user - (ip : 
192.168.4.37)
                2010-01-22 18:48:17 - src/users.c:180 - New user - (ip : 
192.168.4.37)




                  



                -- 
                You received this message because you are subscribed

                to the Google
                Groups "APE Project" group.
                To post to this group, send email to
                [email protected]
                <mailto:[email protected]>
                To unsubscribe from this group, send email to
                [email protected]
                <mailto:ape-project%[email protected]>
                For more options, visit this group at
                http://groups.google.com/group/ape-project?hl=en
                ---
                APE Project (Ajax Push Engine)
                Official website : http://www.ape-project.org/
                Git Hub : http://github.com/APE-Project/



            -- 
            You received this message because you are subscribed to

            the Google
            Groups "APE Project" group.
            To post to this group, send email to
            [email protected]
            <mailto:[email protected]>
            To unsubscribe from this group, send email to
            [email protected]
            <mailto:[email protected]>
            For more options, visit this group at
            http://groups.google.com/group/ape-project?hl=en
            ---
            APE Project (Ajax Push Engine)
            Official website : http://www.ape-project.org/
            Git Hub : http://github.com/APE-Project/



            -- 
            You received this message because you are subscribed to

            the Google
            Groups "APE Project" group.
            To post to this group, send email to
            [email protected]
            <mailto:[email protected]>
            To unsubscribe from this group, send email to
            [email protected]
            <mailto:ape-project%[email protected]>
            For more options, visit this group at
            http://groups.google.com/group/ape-project?hl=en
            ---
            APE Project (Ajax Push Engine)
            Official website : http://www.ape-project.org/
            Git Hub : http://github.com/APE-Project/



        -- 
        You received this message because you are subscribed to the

        Google
        Groups "APE Project" group.
        To post to this group, send email to
        [email protected]
        <mailto:[email protected]>
        To unsubscribe from this group, send email to
        [email protected]
        <mailto:[email protected]>
        For more options, visit this group at
        http://groups.google.com/group/ape-project?hl=en
        ---
        APE Project (Ajax Push Engine)
        Official website : http://www.ape-project.org/
        Git Hub : http://github.com/APE-Project/



        -- 
        You received this message because you are subscribed to the Google

        Groups "APE Project" group.
        To post to this group, send email to
        [email protected] <mailto:[email protected]>
        To unsubscribe from this group, send email to
        [email protected]
        <mailto:ape-project%[email protected]>
        For more options, visit this group at
        http://groups.google.com/group/ape-project?hl=en
        ---
        APE Project (Ajax Push Engine)
        Official website : http://www.ape-project.org/
        Git Hub : http://github.com/APE-Project/



--
You received this message because you are subscribed to the Google
Groups "APE Project" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/ape-project?hl=en
---
APE Project (Ajax Push Engine)
Official website : http://www.ape-project.org/
Git Hub : http://github.com/APE-Project/


--
You received this message because you are subscribed to the Google
Groups "APE Project" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/ape-project?hl=en
---
APE Project (Ajax Push Engine)
Official website : http://www.ape-project.org/
Git Hub : http://github.com/APE-Project/






















					Reply via email to