Hey Mathew, my coworker found the same issue recently, I fixed it on my last pull request, if you'd like to pull from master.
Alternatively, you could comment out the appendCgroups line in myriad-scheduler <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler>/src <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src> /main <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src/main> /java <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src/main/java> /org <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src/main/java/org> /apache <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src/main/java/org/apache> /myriad <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src/main/java/org/apache/myriad> /scheduler <https://github.com/apache/incubator-myriad/tree/0.2.x/myriad-scheduler/src/main/java/org/apache/myriad/scheduler> /*NMExecutorCLGenImpl* and rebuild. Sorry that missed my QA unfortunately I'm always using cgroups and didn't test that. We may do a 0.2.1 release but I can say when. Darin On Aug 16, 2016 8:49 AM, "Matthew J. Loppatto" <mloppa...@keywcorp.com> wrote: > Hi, > > > > I’m setting up Myriad 0.2.0 on my Mesos cluster following this guide: > https://cwiki.apache.org/confluence/display/MYRIAD/ > Installing+for+Developers > > > > And I get the following error in the resource manager executor log in > mesos after starting it with `/opt/hadoop-2.7.2/bin/yarn resourcemanager`: > > > > chown: cannot access > ‘/sys/fs/cgroup/cpu/mesos/f5d6c530-c13d-4b1d-bc30-f298affb6442’: > No such file or directory > > env: /bin/yarn: No such file or directory > > ory > > > > It appears the ‘mesos’ directory doesn’t exist under /sys/fs/cgroup/cpu. > Any ideas what the issue could be? > > > > This is my yarn-site.xml: > > > > <configuration> > > <!-- Site-specific YARN configuration properties --> > > <property> > > <name>yarn.nodemanager.aux-services</name> > > <value>mapreduce_shuffle,myriad_executor</value> > > <!-- If using MapR distro, please use the following value: > > > <value>mapreduce_shuffle,mapr_direct_shuffle,myriad_executor</value> > --> > > </property> > > <property> > > <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name> > > <value>org.apache.hadoop.mapred.ShuffleHandler</value> > > </property> > > <property> > > <name>yarn.nodemanager.aux-services.myriad_executor.class</name> > > <value>org.apache.myriad.executor.MyriadExecutorAuxService</value> > > </property> > > <property> > > <name>yarn.nm.liveness-monitor.expiry-interval-ms</name> > > <value>2000</value> > > </property> > > <property> > > <name>yarn.am.liveness-monitor.expiry-interval-ms</name> > > <value>10000</value> > > </property> > > <property> > > <name>yarn.resourcemanager.nm.liveness-monitor.interval-ms</name> > > <value>1000</value> > > </property> > > <!-- Needed for Fine Grain Scaling --> > > <property> > > <name>yarn.scheduler.minimum-allocation-vcores</name> > > <value>0</value> > > </property> > > <property> > > <name>yarn.scheduler.minimum-allocation-mb</name> > > <value>0</value> > > </property> > > <!-- Site specific YARN configuration properties --> > > <property> > > <name>yarn.nodemanager.resource.cpu-vcores</name> > > <value>${nodemanager.resource.cpu-vcores}</value> > > </property> > > <property> > > <name>yarn.nodemanager.resource.memory-mb</name> > > <value>${nodemanager.resource.memory-mb}</value> > > </property> > > <!--These options enable dynamic port assignment by mesos --> > > <property> > > <name>yarn.nodemanager.address</name> > > <value>${myriad.yarn.nodemanager.address}</value> > > </property> > > <property> > > <name>yarn.nodemanager.webapp.address</name> > > <value>${myriad.yarn.nodemanager.webapp.address}</value> > > </property> > > <property> > > <name>yarn.nodemanager.webapp.https.address</name> > > <value>${myriad.yarn.nodemanager.webapp.address}</value> > > </property> > > <property> > > <name>yarn.nodemanager.localizer.address</name> > > <value>${myriad.yarn.nodemanager.localizer.address}</value> > > </property> > > <!-- Configure Myriad Scheduler here --> > > <property> > > <name>yarn.resourcemanager.scheduler.class</name> > > <value>org.apache.myriad.scheduler.yarn.MyriadFairScheduler</value> > > <description>One can configure other scehdulers as well from following > list: org.apache.myriad.scheduler.yarn.MyriadCapacityScheduler, > org.apache.myriad.scheduler.yarn.MyriadFifoScheduler</description> > > </property> > > <!-- Disable PMem/VMem checks for Hadoop 2.7.2 --> > > <property> > > <name>yarn.nodemanager.pmem-check-enabled</name> > > <value>false</value> > > </property> > > <property> > > <name>yarn.nodemanager.vmem-check-enabled</name> > > <value>false</value> > > </property> > > </configuration> > > > > > > My myriad-config-default.yml: > > > > mesosMaster: zk://myip:2181/mesos > > checkpoint: false > > frameworkFailoverTimeout: 43200000 > > frameworkName: MyriadAlpha > > frameworkRole: > > frameworkUser: root # User the Node Manager runs as, required if > nodeManagerURI set, otherwise defaults to the user > > # running the resource manager. > > frameworkSuperUser: root # To be depricated, currently permissions need > set by a superuser due to Mesos-1790. Must be > > # root or have passwordless sudo. Required if > nodeManagerURI set, ignored otherwise. > > nativeLibrary: /usr/local/lib/libmesos.so > > zkServers: myip:2181 > > zkTimeout: 20000 > > restApiPort: 8192 > > servedConfigPath: dist/config.tgz > > servedBinaryPath: dist/binary.tgz > > profiles: > > zero: # NMs launched with this profile dynamically obtain cpu/mem from > Mesos > > cpu: 0 > > mem: 0 > > small: > > cpu: 2 > > mem: 2048 > > medium: > > cpu: 4 > > mem: 4096 > > large: > > cpu: 10 > > mem: 12288 > > nmInstances: # NMs to start with. Requires at least 1 NM with a non-zero > profile. > > medium: 1 # <profile_name : instances> > > rebalancer: false > > haEnabled: false > > nodemanager: > > jvmMaxMemoryMB: 1024 > > cpus: 0.2 > > cgroups: false > > executor: > > jvmMaxMemoryMB: 256 > > path: file:///usr/local/libexec/mesos/myriad-executor-runnable-0.1.0.jar > > #The following should be used for a remotely distributed URI, hdfs assumed > but other URI types valid. > > #nodeManagerUri: hdfs://namenode:port/dist/hadoop-2.7.0.tar.gz > > #configUri: http://127.0.0.1/api/arifacts/config.tgz > > #jvmUri: https://downloads.mycompany.com/java/jre-7u76-linux-x64.tar.gz > > yarnEnvironment: > > YARN_HOME: /opt/hadoop-2.7.2 > > > > > > Thanks! > > Matt >
