Are you emitting metrics to the ATS? yarn.timeline-service.enabled=true
Sent from my iPhone > On Oct 15, 2016, at 8:36 PM, Sreenath Somarajapuram > <ssomarajapu...@hortonworks.com> wrote: > > Hi Stephen, > > The error message is coming from ATS, and it says that the application data > is not available. > And yes, tez_application_1476574340629_0001 is a legit value. It can be > considered as the id for Tez application details. > > Please help me with these: > 1. Are you having yarn.acl.enable = true in yarn-site.xml ? > 2. On going to http://dwrdevnn1.sv2.trulia.com:9766 from your browser window, > the UI is supposed to display a list of DAGs. Are you able to view them? > > Thanks, > Sreenath > > From: Stephen Sprague <sprag...@gmail.com> > Reply-To: "user@tez.apache.org" <user@tez.apache.org> > Date: Sunday, October 16, 2016 at 7:16 AM > To: "user@tez.apache.org" <user@tez.apache.org> > Subject: Tez UI > > hey guys, > i'm having hard time getting the Tez UI to work. I'm sure i'm doing > something wrong but i can't seem to figure out. Here's my scenario. > > 1. i'm using nginx as the webserver. port 9766. using that port without > params correctly displays index.html. (i followed the instructions on > unzipping the war file - that seems ok - i'm using tez-ui2 ) > > > 2. i run a Tez job. It runs fine. > > > 3. i click on the "History" hyperlink in the RM UI at 8088. > > > 4. it attempts to run > http://dwrdevnn1.sv2.trulia.com:8088/proxy/application_1476574340629_0001/#/tez-app/application_1476574340629_0001 > > > 5. which yields this error: > > > > i see "id: tez_application_1476574340629_0001" is that "tez_" prefix legit? > > > > 6. the ATS is running on port 8188. I've modified the file > config/configs.env as well: cf. timeline: > "http://dwrdevnn1.sv2.trulia.com:8188";, > > > 7. here are those details: > > yarn 29762 1 12 18:10 pts/5 00:00:11 > /usr/lib/jvm/java-8-oracle/jre/bin/java -Dproc_timelineserver -Xmx1000m > -Dhadoop.log.dir=/var/log/hadoop-yarn -Dyarn.log.dir=/var/log/hadoop-yarn > -Dhadoop.log.file=yarn-yarn-timelineserver-dwrdevnn1.log > -Dyarn.log.file=yarn-yarn-timelineserver-dwrdevnn1.log -Dyarn.home.dir= > -Dyarn.id.str=yarn -Dhadoop.root.logger=INFO,RFA -Dyarn.root.logger=INFO,RFA > -Djava.library.path=/usr/lib/hadoop/lib/native > -Dyarn.policy.file=hadoop-policy.xml -Dhadoop.log.dir=/var/log/hadoop-yarn > -Dyarn.log.dir=/var/log/hadoop-yarn > -Dhadoop.log.file=yarn-yarn-timelineserver-dwrdevnn1.log > -Dyarn.log.file=yarn-yarn-timelineserver-dwrdevnn1.log > -Dyarn.home.dir=/usr/lib/hadoop-yarn -Dhadoop.home.dir=/usr/lib/hadoop-yarn > -Dhadoop.root.logger=INFO,RFA -Dyarn.root.logger=INFO,RFA > -Djava.library.path=/usr/lib/hadoop/lib/native -classpath > /etc/hadoop/conf:/etc/hadoop/conf:/etc/hadoop/conf:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/.//*:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-hdfs/.//*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-mapreduce/lib/*:/usr/lib/hadoop-mapreduce/.//*:/opt/pepperdata/lib/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-yarn/lib/*:/etc/hadoop/conf/timelineserver-config/log4j.properties > > org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer > > $ sudo netstat -lanp |grep 29762 > tcp 0 0 0.0.0.0:10200 0.0.0.0:* LISTEN > 29762/java > tcp 0 0 0.0.0.0:8188 0.0.0.0:* LISTEN > 29762/java > > > > 8. the configs in yarn-site.xml > <property> > <name>yarn.timeline-service.hostname</name> > <value>0.0.0.0</value> > </property> > <property> > <name>yarn.timeline-service.enabled</name> > <value>true</value> > </property> > <property> > <name>yarn.timeline-service.webapp.address</name> > <value>0.0.0.0:8188</value> > </property> > <property> > <name>yarn.timeline-service.http-cross-origin.enabled</name> > <value>true</value> > </property> > <property> > <name>yarn.resourcemanager.system-metrics-publisher.enabled</name> > <value>true</value> > </property> > > > 9. and tez-site.xml are as follows: > <property> > <description>Enable Tez to use the Timeline Server for History > Logging</description> > <name>tez.history.logging.service.class</name> > > <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value> > </property> > > <!-- port 9766 defined in nginx config file --> > <property> > <description>URL for where the Tez UI is hosted</description> > <name>tez.tez-ui.history-url.base</name> > <value>http://dwrdevnn1.sv2.trulia.com:9766</value> > </property> > > <!-- from tez-ui README.txt --> > <property> > <name>tez.runtime.convert.user-payload.to.history-text</name> > <value>true</value> > <description>Should be enabled to get the configuration options. If > enabled, the config options are set as > userpayload per input/output. > </description> > </property> > > <property> > <name>tez.allow.disabled.timeline-domains</name> > <value>true</value> > </property> > > > > So i don't get it. Any ideas why this fails? > > thanks, > Stephen. > > > <image.png>
