There is some history logging done that can be enabled via the SimpleHistoryLogger. This activates by default if ATS logger is not enabled. This is not fully compatible with the ATS data and also as it is mostly experimental, it may not have all the data. To use it, you can configure the “tez.history.logging.service.class” to “” or “org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService”. The config property “tez.simple.history.logging.dir” controls the path on HDFS where the history is written to. If the dir path is not configured, it writes the logs as part of the Application Master container logs which can then be pulled via “bin/yarn logs -application”
Using the HDFS logger does imply that the UI will no longer be functional. thanks — Hitesh On May 21, 2015, at 4:14 PM, Xiaoyong Zhu <[email protected]> wrote: > Hi, I am wondering if I didn’t configure YARN ATS integration, where would be > the tez log (I mean the data available in /ws/v1/timeline/TEZ_DAG_ID if there > is an integration happening) go to HDFS? Is there a configuration for that? > > Thanks! > > Xiaoyong
