AFAIK, Apex delegates log management to Hadoop/Yarn and the application.
It is possible to retain logs both with log aggregation enabled and
disabled. If aggregation is enabled, Yarn will consolidate logs from all
nodes once application is completed and delete them after
yarn.log-aggregation.retain-seconds, if aggregation is disabled, logs
will be retained for yarn.nodemanager.log.retain-seconds (default 3
hours). Please see Hadoop/Yarn documentation for further details.
Thank you,
Vlad
On 12/12/16 06:42, Munagala Ramanath wrote:
Once log aggregation is enabled as Priyanka described, you can
retrieve logs for a specific
application with a command like this:
*yarn logs -applicationId application_1473359658420_0588*
Ram
On Mon, Dec 12, 2016 at 2:29 AM, Priyanka Gugale <pri...@apache.org
<mailto:pri...@apache.org>> wrote:
You need to set hadoop configuration "yarn.log-aggregation-enable"
to true, so that logs will be retained even after application is
terminated.
-Priyanka
On Mon, Dec 12, 2016 at 3:42 PM, chiranjeevi vasupilli
<chiru....@gmail.com <mailto:chiru....@gmail.com>> wrote:
Hi team,
How to maintain application logs in DataTorrent. Even after
the job gets completed we would like to check the logs.
Please suggest.
Thank You
Chiru
