If I pass this configuration in to YARN on HDP2.2 using Ambari 2.0:
"yarn.timeline-service.leveldb-timeline-store.path":
'hdfs:///apps/yarn/timeline'
It spins forever waiting to set up the HDFS paths for me. I like that it tries
to auto-create the folder for me, but maybe there's an order-of-operations
problem here? It's been going for 20 minutes now, just sitting there.
Also, if the desired behavior is to auto-create the hdfs folders, this other
setting needs to be updated to work the same way:
"yarn.resourcemanager.fs.state-store.uri": 'hdfs:///apps/yarn/rmstore'
Setting that just makes the resource manager crash until I can go in and create
the folder in hdfs.
Here's the task output that's hanging. Advice is appreciated, but I have a
feeling I'm just going to be opening bug reports here.
2015-05-13 19:39:09,834 - u"XmlConfig['capacity-scheduler.xml']" {'group':
'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644,
'configuration_attributes': {}, 'owner': 'yarn', 'configurations': ...}
2015-05-13 19:39:09,850 - Generating config:
/etc/hadoop/conf/capacity-scheduler.xml
2015-05-13 19:39:09,850 - u"File['/etc/hadoop/conf/capacity-scheduler.xml']"
{'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
0644, 'encoding': 'UTF-8'}
2015-05-13 19:39:10,075 - Writing
u"File['/etc/hadoop/conf/capacity-scheduler.xml']" because contents don't match
2015-05-13 19:39:10,255 - Changing owner for
/etc/hadoop/conf/capacity-scheduler.xml from 0 to yarn
2015-05-13 19:39:10,305 - Changing group for
/etc/hadoop/conf/capacity-scheduler.xml from 0 to hadoop
2015-05-13 19:39:10,355 - u"Directory['hdfs:///apps/yarn/timeline']" {'owner':
'yarn', 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2015-05-13 19:39:10,411 - Creating directory
u"Directory['hdfs:///apps/yarn/timeline']"
2015-05-13 19:39:10,670 - Changing owner for hdfs:///apps/yarn/timeline from 0
to yarn
2015-05-13 19:39:10,720 - Changing group for hdfs:///apps/yarn/timeline from 0
to hadoop
