The name of the property is dt.attr. CONTAINER_JVM_OPTIONS. You don't need to replace <LOG_DIR> with the actual path as it is not known till an application and a containers are allocated by Yarn (Apex will replace <LOG_DIR> with the container log directory). You may also set the attribute at the launch time: -Ddt.attr.CONTAINER_JVM_OPTIONS="-Xloggc:<LOG_DIR>/gc.log -verbose:gc -XX:+PrintGCDateStamps" or using DT RTS console.

Thank you,

Vlad

/Join us at Apex Big Data World-San Jose <http://www.apexbigdata.com/san-jose.html>, April 4, 2017/ http://www.apexbigdata.com/san-jose-register.html <http://www.apexbigdata.com/san-jose-register.html>
On 2/21/17 00:44, Ambarish Pande wrote:
I cant find the gc.log file in container logs folder. Do i have to replace the LOG_DIR with a path?

On Tue, Feb 21, 2017 at 12:21 PM, Tushar Gosavi <tus...@datatorrent.com <mailto:tus...@datatorrent.com>> wrote:

    Hi Ambarish,

    you could add following property in your applications
    properties.xml file.

    <property>
    <name>dt.application.*.attr.containerJvmOpts</name>
    <value>-Xloggc:&lt;LOG_DIR&gt;/gc.log -verbose:gc
    -XX:+PrintGCDateStamps</value>
      </property>

    when this property is used, you will see gc.log file in container
    directory.

    - Tushar.


    On Tue, Feb 21, 2017 at 12:06 PM, Ambarish Pande
    <ambarish.pande2...@gmail.com
    <mailto:ambarish.pande2...@gmail.com>> wrote:
    > Hello,
    >
    > I tried enabling gclogs in hadoop configurations. Do I need to
    enable it in
    > Datatorrent RTS somewhere or in my app?. If so, how should I do it?
    >
    > Thank You
    >
    > On Fri, Feb 17, 2017 at 1:20 PM, Ashwin Chandra Putta
    > <ashwinchand...@gmail.com <mailto:ashwinchand...@gmail.com>> wrote:
    >>
    >> It is probably not able to keep up with the throughput and
    might need more
    >> partitions. Check the CPU and memory utilization of its
    container. If memory
    >> allocated to container is too low, it might be hitting GC too
    often. You can
    >> enable GC logging and check GC logs.
    >>
    >> Regards,
    >> Ashwin.
    >>
    >>
    >> On Feb 16, 2017 11:12 PM, "Ambarish Pande"
    <ambarish.pande2...@gmail.com <mailto:ambarish.pande2...@gmail.com>>
    >> wrote:
    >>
    >> Hello,
    >>
    >> I wanted to know why my operator latency is increasing. Which
    logs should
    >> I check to get any idea about that. I have checked the
    container dt.log ,
    >> stderr and stdout, but I cannot find anything there.
    >>
    >> Thank You
    >>
    >>
    >



Reply via email to