Hi , how could I found GPU resource in Mesos 1.0 ? it seems that the Mesos
1.0 already support GPU . But when I follow the
https://open.mesosphere.com/getting-started/install/ and install those
RPMs in our servers. It seems that it just found CPU/Memory/Disk resource.
But GPU can';t be found by Mesos 1.0 master.
The following is logs when I startup Mesos 1.0 agent (GPU installed) with
command "systemctl start mesos-slave . I can see the it found GPU in agent
log . But Mesos master can't display GPU .
Log when start up mesos agent by "systemctl start mesos-slave "
.....
I0818 08:58:51.993185 103239 slave.cpp:519] Agent resources: gpus(*):[0-1];
cpus(*):48; mem(*):772718; disk(*):145941; ports(*):[31000-32000]
I0818 08:58:51.993273 103239 slave.cpp:527] Agent attributes: [ ]
.....
Log when start by command : mesos-agent --master=10.101.1.22:5050
--work_dir=/var/lib/mesos --resources=gpus:2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0823 08:30:57.292623 136165 main.cpp:243] Build: 2016-07-27 20:21:03 by
centos
I0823 08:30:57.292881 136165 main.cpp:244] Version: 1.0.0
I0823 08:30:57.292901 136165 main.cpp:247] Git tag: 1.0.0
I0823 08:30:57.292914 136165 main.cpp:251] Git SHA:
c9b70582e9fccab8f6863b0bd3a812b5969a8c24
I0823 08:30:57.303582 136165 systemd.cpp:237] systemd version `219`
detected
I0823 08:30:57.303639 136165 main.cpp:342] Inializing systemd state
I0823 08:30:57.326640 136165 systemd.cpp:325] Started systemd slice
`mesos_executors.slice`
Failed to create a containerizer: Failed to NvidiaGpuAllocator::create:
Failed to nvml::deviceGetHandleByIndex: NVML has not been initialized
I am sure that GPU function work normal on that host. BTW, when I using
Mesos 0.28 (package build from source code) agent and connect with Mesos
1.0 master. Mesos master could report GPU status but can't dispatch job on
those nodes.
Please advise what could I do to manage GPU resource in Mesos 1.0 ? Thank
you .
Warm regards,
Jef Chiu 邱征輝
TCCD/ICSD/IT
Taiwan Semiconductor Manufacturing Company
---------------------------------------------------------------------------
TSMC PROPERTY
This email communication (and any attachments) is proprietary information
for the sole use of its
intended recipient. Any unauthorized review, use or distribution by anyone
other than the intended
recipient is strictly prohibited. If you are not the intended recipient,
please notify the sender by
replying to this email, and then delete this email and any copies of it
immediately. Thank you.
---------------------------------------------------------------------------
