Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-25 Thread 
Clusters are not ready to go just yet. please sign up via this link -
https://goo.gl/forms/HR0Upm9w30DW8aIU2

On Oct 25, 2017 8:11 AM, "Itamar O"  wrote:

> I already took that cluster down, so I'll reproduce it later and run
> `kubectl describe no`.
> What user guide are you referring to? I was under the impression that
> using GKE with the Google optimized images gives me ready-to-go-machines.
> The user guide I'm familiar with talks about installing GPU drivers on GCE
> instances that I spin up on my own, not GKE-managed instances.
>
> On Wed, Oct 25, 2017 at 5:25 PM 'Vishnu Kannan' via Kubernetes user
> discussion and Q&A  wrote:
>
>> Can you post output of 'kubectl describe no'? Did you follow the user
>> guide to install drivers?
>>
>> On Oct 25, 2017 7:23 AM, "Itamar O"  wrote:
>>
>>> Vishnu,
>>> I have an alpha cluster on GKE with GPU (project is whitelisted, running
>>> 1.7.8), but I am unable to schedule workloads that require GPUs:
>>> [image: unnamed.png]
>>>
>>> example YAML for reproducing this:
>>> apiVersion: apps/v1beta1
>>> kind: Deployment
>>> metadata:
>>>   name: my-tf
>>>   labels:
>>> app: tf
>>> spec:
>>>   selector:
>>> matchLabels:
>>>   app: tf
>>>   replicas: 1
>>>   template:
>>> metadata:
>>>   labels:
>>> app: tf
>>> spec:
>>>   containers:
>>>   - image: tensorflow/tensorflow:latest-gpu
>>> name: my-tf
>>> ports:
>>> - containerPort: 
>>> resources:
>>>   limits:
>>> *alpha.kubernetes.io/nvidia-gpu
>>> : 1*
>>>
>>> Am I missing something?
>>> Thanks.
>>>
>>> On Mon, Oct 23, 2017 at 11:00 PM 'Vishnu Kannan' via Kubernetes user
>>> discussion and Q&A  wrote:
>>>
 Hey there, if you are trying out alpha experience for GPUs on GKE,
 please sign up via this form 
 and request access to the doc listed in the form. If you have issues with
 GKE after going through the user guide, please PM me and I'll help you out.

 On Mon, Oct 23, 2017 at 12:48 AM,  wrote:

> Hi Vishnu,
>
> I am also trying to run a GPU cluster on GKE. And also hitting
> allocatable GPU = 0 problem. Can you please guide me?
>
> On Tuesday, October 17, 2017 at 6:36:20 AM UTC+9, Vishnu Kannan wrote:
> > GPU support in kubernetes is moving out of tree using a new
> extension mechanism called device plugins. Nvidia has published a GPU
> device plugin recently that is expected to work with kubernetes v1.8.
> >
> >
> > If you are on GCP, please reach out to me and I can share an
> official alpha user guide for GPUs with k8s.
> >
> >
> > On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
> >
> >
> > Hi Vu Pham,
> >
> > My allocatable GPU number is 0.
> >
> > Can you advise how you overcome the issue?
> >
> > Thanks, Burt
> >
> >
> >
> >
> >
> > --
> >
> > You received this message because you are subscribed to the Google
> Groups "Kubernetes user discussion and Q&A" group.
> >
> > To unsubscribe from this group and stop receiving emails from it,
> send an email to kubernetes-use...@googlegroups.com.
> >
> > To post to this group, send email to kubernet...@googlegroups.com.
> >
> > Visit this group at https://groups.google.com/group/kubernetes-users
> .
> >
> > For more options, visit https://groups.google.com/d/optout.
>
> --
> You received this message because you are subscribed to the Google
> Groups "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com
> .
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>

 --
 You received this message because you are subscribed to the Google
 Groups "Kubernetes user discussion and Q&A" group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to kubernetes-users+unsubscr...@googlegroups.com.
 To post to this group, send email to kubernetes-users@googlegroups.com.
 Visit this group at https://groups.google.com/group/kubernetes-users.
 For more options, visit https://groups.google.com/d/optout.

>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Kubernetes user discussion and Q&A" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to kubernetes-users+unsubscr...@googlegroups.com.
>>> To post to this group, send email to kubernetes-users@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/kubernetes-users.
>>> For more options, v

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-25 Thread Itamar O 
I already took that cluster down, so I'll reproduce it later and run
`kubectl describe no`.
What user guide are you referring to? I was under the impression that using
GKE with the Google optimized images gives me ready-to-go-machines.
The user guide I'm familiar with talks about installing GPU drivers on GCE
instances that I spin up on my own, not GKE-managed instances.

On Wed, Oct 25, 2017 at 5:25 PM 'Vishnu Kannan' via Kubernetes user
discussion and Q&A  wrote:

> Can you post output of 'kubectl describe no'? Did you follow the user
> guide to install drivers?
>
> On Oct 25, 2017 7:23 AM, "Itamar O"  wrote:
>
>> Vishnu,
>> I have an alpha cluster on GKE with GPU (project is whitelisted, running
>> 1.7.8), but I am unable to schedule workloads that require GPUs:
>> [image: unnamed.png]
>>
>> example YAML for reproducing this:
>> apiVersion: apps/v1beta1
>> kind: Deployment
>> metadata:
>>   name: my-tf
>>   labels:
>> app: tf
>> spec:
>>   selector:
>> matchLabels:
>>   app: tf
>>   replicas: 1
>>   template:
>> metadata:
>>   labels:
>> app: tf
>> spec:
>>   containers:
>>   - image: tensorflow/tensorflow:latest-gpu
>> name: my-tf
>> ports:
>> - containerPort: 
>> resources:
>>   limits:
>> *alpha.kubernetes.io/nvidia-gpu
>> : 1*
>>
>> Am I missing something?
>> Thanks.
>>
>> On Mon, Oct 23, 2017 at 11:00 PM 'Vishnu Kannan' via Kubernetes user
>> discussion and Q&A  wrote:
>>
>>> Hey there, if you are trying out alpha experience for GPUs on GKE,
>>> please sign up via this form 
>>> and request access to the doc listed in the form. If you have issues with
>>> GKE after going through the user guide, please PM me and I'll help you out.
>>>
>>> On Mon, Oct 23, 2017 at 12:48 AM,  wrote:
>>>
 Hi Vishnu,

 I am also trying to run a GPU cluster on GKE. And also hitting
 allocatable GPU = 0 problem. Can you please guide me?

 On Tuesday, October 17, 2017 at 6:36:20 AM UTC+9, Vishnu Kannan wrote:
 > GPU support in kubernetes is moving out of tree using a new extension
 mechanism called device plugins. Nvidia has published a GPU device plugin
 recently that is expected to work with kubernetes v1.8.
 >
 >
 > If you are on GCP, please reach out to me and I can share an official
 alpha user guide for GPUs with k8s.
 >
 >
 > On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
 >
 >
 > Hi Vu Pham,
 >
 > My allocatable GPU number is 0.
 >
 > Can you advise how you overcome the issue?
 >
 > Thanks, Burt
 >
 >
 >
 >
 >
 > --
 >
 > You received this message because you are subscribed to the Google
 Groups "Kubernetes user discussion and Q&A" group.
 >
 > To unsubscribe from this group and stop receiving emails from it,
 send an email to kubernetes-use...@googlegroups.com.
 >
 > To post to this group, send email to kubernet...@googlegroups.com.
 >
 > Visit this group at https://groups.google.com/group/kubernetes-users.
 >
 > For more options, visit https://groups.google.com/d/optout.

 --
 You received this message because you are subscribed to the Google
 Groups "Kubernetes user discussion and Q&A" group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to kubernetes-users+unsubscr...@googlegroups.com.
 To post to this group, send email to kubernetes-users@googlegroups.com.
 Visit this group at https://groups.google.com/group/kubernetes-users.
 For more options, visit https://groups.google.com/d/optout.

>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Kubernetes user discussion and Q&A" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to kubernetes-users+unsubscr...@googlegroups.com.
>>> To post to this group, send email to kubernetes-users@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/kubernetes-users.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Kubernetes user discussion and Q&A" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to kubernetes-users+unsubscr...@googlegroups.com.
>> To post to this group, send email to kubernetes-users@googlegroups.com.
>> Visit this group at https://groups.google.com/group/kubernetes-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> T

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-25 Thread 
Can you post output of 'kubectl describe no'? Did you follow the user guide
to install drivers?

On Oct 25, 2017 7:23 AM, "Itamar O"  wrote:

> Vishnu,
> I have an alpha cluster on GKE with GPU (project is whitelisted, running
> 1.7.8), but I am unable to schedule workloads that require GPUs:
> [image: unnamed.png]
>
> example YAML for reproducing this:
> apiVersion: apps/v1beta1
> kind: Deployment
> metadata:
>   name: my-tf
>   labels:
> app: tf
> spec:
>   selector:
> matchLabels:
>   app: tf
>   replicas: 1
>   template:
> metadata:
>   labels:
> app: tf
> spec:
>   containers:
>   - image: tensorflow/tensorflow:latest-gpu
> name: my-tf
> ports:
> - containerPort: 
> resources:
>   limits:
> *alpha.kubernetes.io/nvidia-gpu
> : 1*
>
> Am I missing something?
> Thanks.
>
> On Mon, Oct 23, 2017 at 11:00 PM 'Vishnu Kannan' via Kubernetes user
> discussion and Q&A  wrote:
>
>> Hey there, if you are trying out alpha experience for GPUs on GKE, please 
>> sign
>> up via this form  and request
>> access to the doc listed in the form. If you have issues with GKE after
>> going through the user guide, please PM me and I'll help you out.
>>
>> On Mon, Oct 23, 2017 at 12:48 AM,  wrote:
>>
>>> Hi Vishnu,
>>>
>>> I am also trying to run a GPU cluster on GKE. And also hitting
>>> allocatable GPU = 0 problem. Can you please guide me?
>>>
>>> On Tuesday, October 17, 2017 at 6:36:20 AM UTC+9, Vishnu Kannan wrote:
>>> > GPU support in kubernetes is moving out of tree using a new extension
>>> mechanism called device plugins. Nvidia has published a GPU device plugin
>>> recently that is expected to work with kubernetes v1.8.
>>> >
>>> >
>>> > If you are on GCP, please reach out to me and I can share an official
>>> alpha user guide for GPUs with k8s.
>>> >
>>> >
>>> > On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
>>> >
>>> >
>>> > Hi Vu Pham,
>>> >
>>> > My allocatable GPU number is 0.
>>> >
>>> > Can you advise how you overcome the issue?
>>> >
>>> > Thanks, Burt
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> >
>>> > You received this message because you are subscribed to the Google
>>> Groups "Kubernetes user discussion and Q&A" group.
>>> >
>>> > To unsubscribe from this group and stop receiving emails from it, send
>>> an email to kubernetes-use...@googlegroups.com.
>>> >
>>> > To post to this group, send email to kubernet...@googlegroups.com.
>>> >
>>> > Visit this group at https://groups.google.com/group/kubernetes-users.
>>> >
>>> > For more options, visit https://groups.google.com/d/optout.
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Kubernetes user discussion and Q&A" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to kubernetes-users+unsubscr...@googlegroups.com.
>>> To post to this group, send email to kubernetes-users@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/kubernetes-users.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Kubernetes user discussion and Q&A" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to kubernetes-users+unsubscr...@googlegroups.com.
>> To post to this group, send email to kubernetes-users@googlegroups.com.
>> Visit this group at https://groups.google.com/group/kubernetes-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-25 Thread Itamar O 
Vishnu,
I have an alpha cluster on GKE with GPU (project is whitelisted, running
1.7.8), but I am unable to schedule workloads that require GPUs:
[image: unnamed.png]

example YAML for reproducing this:
apiVersion: apps/v1beta1
kind: Deployment
metadata:
  name: my-tf
  labels:
app: tf
spec:
  selector:
matchLabels:
  app: tf
  replicas: 1
  template:
metadata:
  labels:
app: tf
spec:
  containers:
  - image: tensorflow/tensorflow:latest-gpu
name: my-tf
ports:
- containerPort: 
resources:
  limits:
*alpha.kubernetes.io/nvidia-gpu
: 1*

Am I missing something?
Thanks.

On Mon, Oct 23, 2017 at 11:00 PM 'Vishnu Kannan' via Kubernetes user
discussion and Q&A  wrote:

> Hey there, if you are trying out alpha experience for GPUs on GKE, please sign
> up via this form  and request
> access to the doc listed in the form. If you have issues with GKE after
> going through the user guide, please PM me and I'll help you out.
>
> On Mon, Oct 23, 2017 at 12:48 AM,  wrote:
>
>> Hi Vishnu,
>>
>> I am also trying to run a GPU cluster on GKE. And also hitting
>> allocatable GPU = 0 problem. Can you please guide me?
>>
>> On Tuesday, October 17, 2017 at 6:36:20 AM UTC+9, Vishnu Kannan wrote:
>> > GPU support in kubernetes is moving out of tree using a new extension
>> mechanism called device plugins. Nvidia has published a GPU device plugin
>> recently that is expected to work with kubernetes v1.8.
>> >
>> >
>> > If you are on GCP, please reach out to me and I can share an official
>> alpha user guide for GPUs with k8s.
>> >
>> >
>> > On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
>> >
>> >
>> > Hi Vu Pham,
>> >
>> > My allocatable GPU number is 0.
>> >
>> > Can you advise how you overcome the issue?
>> >
>> > Thanks, Burt
>> >
>> >
>> >
>> >
>> >
>> > --
>> >
>> > You received this message because you are subscribed to the Google
>> Groups "Kubernetes user discussion and Q&A" group.
>> >
>> > To unsubscribe from this group and stop receiving emails from it, send
>> an email to kubernetes-use...@googlegroups.com.
>> >
>> > To post to this group, send email to kubernet...@googlegroups.com.
>> >
>> > Visit this group at https://groups.google.com/group/kubernetes-users.
>> >
>> > For more options, visit https://groups.google.com/d/optout.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Kubernetes user discussion and Q&A" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to kubernetes-users+unsubscr...@googlegroups.com.
>> To post to this group, send email to kubernetes-users@googlegroups.com.
>> Visit this group at https://groups.google.com/group/kubernetes-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-23 Thread 
Hey there, if you are trying out alpha experience for GPUs on GKE, please sign
up via this form  and request
access to the doc listed in the form. If you have issues with GKE after
going through the user guide, please PM me and I'll help you out.

On Mon, Oct 23, 2017 at 12:48 AM,  wrote:

> Hi Vishnu,
>
> I am also trying to run a GPU cluster on GKE. And also hitting allocatable
> GPU = 0 problem. Can you please guide me?
>
> On Tuesday, October 17, 2017 at 6:36:20 AM UTC+9, Vishnu Kannan wrote:
> > GPU support in kubernetes is moving out of tree using a new extension
> mechanism called device plugins. Nvidia has published a GPU device plugin
> recently that is expected to work with kubernetes v1.8.
> >
> >
> > If you are on GCP, please reach out to me and I can share an official
> alpha user guide for GPUs with k8s.
> >
> >
> > On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
> >
> >
> > Hi Vu Pham,
> >
> > My allocatable GPU number is 0.
> >
> > Can you advise how you overcome the issue?
> >
> > Thanks, Burt
> >
> >
> >
> >
> >
> > --
> >
> > You received this message because you are subscribed to the Google
> Groups "Kubernetes user discussion and Q&A" group.
> >
> > To unsubscribe from this group and stop receiving emails from it, send
> an email to kubernetes-use...@googlegroups.com.
> >
> > To post to this group, send email to kubernet...@googlegroups.com.
> >
> > Visit this group at https://groups.google.com/group/kubernetes-users.
> >
> > For more options, visit https://groups.google.com/d/optout.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-23 Thread ktsai 
Hi Vishnu,

I am also trying to run a GPU cluster on GKE. And also hitting allocatable GPU 
= 0 problem. Can you please guide me? 

On Tuesday, October 17, 2017 at 6:36:20 AM UTC+9, Vishnu Kannan wrote:
> GPU support in kubernetes is moving out of tree using a new extension 
> mechanism called device plugins. Nvidia has published a GPU device plugin 
> recently that is expected to work with kubernetes v1.8. 
> 
> 
> If you are on GCP, please reach out to me and I can share an official alpha 
> user guide for GPUs with k8s. 
> 
> 
> On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
> 
> 
> Hi Vu Pham,
> 
> My allocatable GPU number is 0.
> 
> Can you advise how you overcome the issue?
> 
> Thanks, Burt
> 
> 
> 
> 
> 
> --
> 
> You received this message because you are subscribed to the Google Groups 
> "Kubernetes user discussion and Q&A" group.
> 
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to kubernetes-use...@googlegroups.com.
> 
> To post to this group, send email to kubernet...@googlegroups.com.
> 
> Visit this group at https://groups.google.com/group/kubernetes-users.
> 
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-17 Thread burtchensu 
On Tuesday, October 17, 2017 at 5:36:20 AM UTC+8, Vishnu Kannan wrote:
> GPU support in kubernetes is moving out of tree using a new extension 
> mechanism called device plugins. Nvidia has published a GPU device plugin 
> recently that is expected to work with kubernetes v1.8. 
> 
> 
> If you are on GCP, please reach out to me and I can share an official alpha 
> user guide for GPUs with k8s. 
> 
> 
> On Mon, Oct 16, 2017 at 12:54 AM,   wrote:
> 
> 
> Hi Vu Pham,
> 
> My allocatable GPU number is 0.
> 
> Can you advise how you overcome the issue?
> 
> Thanks, Burt
> 
> 
> 
> 
> 
> --
> 
> You received this message because you are subscribed to the Google Groups 
> "Kubernetes user discussion and Q&A" group.
> 
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to kubernetes-use...@googlegroups.com.
> 
> To post to this group, send email to kubernet...@googlegroups.com.
> 
> Visit this group at https://groups.google.com/group/kubernetes-users.
> 
> For more options, visit https://groups.google.com/d/optout.

Thanks, Vishnu! Following your instructions, there's error messages on the 
requirements of CUDA 9.0. Mine is CUDA 7.5. In process. 
Thank you

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-16 Thread 
GPU support in kubernetes is moving out of tree using a new extension
mechanism called device plugins
.
Nvidia has published a GPU device plugin recently
that is expected to work with
kubernetes v1.8.

If you are on GCP, please reach out to me and I can share an official alpha
user guide for GPUs with k8s.

On Mon, Oct 16, 2017 at 12:54 AM,  wrote:

>
> Hi Vu Pham,
> My allocatable GPU number is 0.
> Can you advise how you overcome the issue?
> Thanks, Burt
>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-16 Thread burtchensu 

Hi Vu Pham,
My allocatable GPU number is 0.
Can you advise how you overcome the issue?
Thanks, Burt

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2017-10-16 Thread burtchensu 
On Tuesday, December 20, 2016 at 12:00:41 AM UTC+8, Vu Pham wrote:
> Nevermind, it's my bad. I was using the wrong binaries :)
> It's working now. I am gonna bring it to the cluster.
> 
> 
> Looking forward to see new features for GPUs in the codebase. Things like 
> Memory management and so on would be very helpful.
> 
> 
> Thanks and cheers,
> 
> 
> On Mon, Dec 19, 2016 at 3:55 PM,   wrote:
> Awesome!
> 
> 
> 
> I checked out the branch, rebase with master, compiled it and deploy on a 
> single-node Ubuntu 14.04 machine.
> 
> However, when I run "kubectl describe nodes", it shows:
> 
> 
> 
> Capacity:
> 
>  alpha.kubernetes.io/nvidia-gpu:        0
> 
> 
> 
> 
> 
> Allocatable:
> 
>  alpha.kubernetes.io/nvidia-gpu:        0
> 
> 
> 
> 
> 
> I am pretty sure I have 2 GPUs on the machines, with CUDA driver properly 
> installed (I can see nvidia0, nvidia1, nvidiactl, nvidia-uvm under /dev).
> 
> 
> 
> I am in the middle of debugging this, but just want to check if anyone 
> experiences something similar?
> 
> 
> 
> Regards,
> 
> Vu
> 
> 
> 
> On Sunday, December 4, 2016 at 10:38:51 AM UTC+1, Hui-Zhi Zhao wrote:
> 
> > Hi all,
> 
> >
> 
> >
> 
> > I have rebased #28216, any comment is welcome. Meanwhile, I will add more 
> > logs and annotations.
> 
> >
> 
> >
> 
> >
> 
> >
> 
> > Regards,
> 
> > Hui-Zhi Zhao
> 
> >
> 
> >
> 
> >
> 
> > On 30 Nov 2016, at 7:12 PM, Hui-Zhi Zhao  wrote:
> 
> >
> 
> >
> 
> >
> 
> > Great! I am working on rebase my 
> > pr(https://github.com/kubernetes/kubernetes/pull/28216).
> 
> >
> 
> >
> 
> > Regards,
> 
> > Hui-Zhi Zhao
> 
> >
> 
> >
> 
> >
> 
> 
> 
> > On 30 Nov 2016, at 6:28 PM, Vishnu Kannan  wrote:
> 
> >
> 
> > this
> 
> 
> 
> --
> 
> You received this message because you are subscribed to a topic in the Google 
> Groups "Kubernetes user discussion and Q&A" group.
> 
> To unsubscribe from this topic, visit 
> https://groups.google.com/d/topic/kubernetes-users/pP3M2k4J0CU/unsubscribe.
> 
> To unsubscribe from this group and all its topics, send an email to 
> kubernetes-use...@googlegroups.com.
> 
> To post to this group, send email to kubernet...@googlegroups.com.
> 
> Visit this group at https://groups.google.com/group/kubernetes-users.
> 
> For more options, visit https://groups.google.com/d/optout.
> 
> 
> 
> 
> 
> -- 
> 
> 
> 
> 
> 
> PHAM Hoai Vu
> LinkedIn: linkedin.com/in/vuphoai

Hi Vu Pham, 
My allocatable GPU number is 0.
Can you advise how you overcome the issue?
Thanks, Burt

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2016-12-19 Thread Vu Pham 
Nevermind, it's my bad. I was using the wrong binaries :)
It's working now. I am gonna bring it to the cluster.

Looking forward to see new features for GPUs in the codebase. Things like
Memory management and so on would be very helpful.

Thanks and cheers,

On Mon, Dec 19, 2016 at 3:55 PM,  wrote:

> Awesome!
>
> I checked out the branch, rebase with master, compiled it and deploy on a
> single-node Ubuntu 14.04 machine.
> However, when I run "kubectl describe nodes", it shows:
>
> Capacity:
>  alpha.kubernetes.io/nvidia-gpu:0
> 
>
> Allocatable:
>  alpha.kubernetes.io/nvidia-gpu:0
> 
>
> I am pretty sure I have 2 GPUs on the machines, with CUDA driver properly
> installed (I can see nvidia0, nvidia1, nvidiactl, nvidia-uvm under /dev).
>
> I am in the middle of debugging this, but just want to check if anyone
> experiences something similar?
>
> Regards,
> Vu
>
> On Sunday, December 4, 2016 at 10:38:51 AM UTC+1, Hui-Zhi Zhao wrote:
> > Hi all,
> >
> >
> > I have rebased #28216, any comment is welcome. Meanwhile, I will add
> more logs and annotations.
> >
> >
> >
> >
> > Regards,
> > Hui-Zhi Zhao
> >
> >
> >
> > On 30 Nov 2016, at 7:12 PM, Hui-Zhi Zhao  wrote:
> >
> >
> >
> > Great! I am working on rebase my pr(https://github.com/
> kubernetes/kubernetes/pull/28216).
> >
> >
> > Regards,
> > Hui-Zhi Zhao
> >
> >
> >
> > On 30 Nov 2016, at 6:28 PM, Vishnu Kannan  wrote:
> >
> > this
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/kubernetes-users/pP3M2k4J0CU/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
PHAM Hoai Vu
LinkedIn: linkedin.com/in/vuphoai

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2016-12-19 Thread phvu225 
Awesome!

I checked out the branch, rebase with master, compiled it and deploy on a 
single-node Ubuntu 14.04 machine.
However, when I run "kubectl describe nodes", it shows:

Capacity:
 alpha.kubernetes.io/nvidia-gpu:0


Allocatable:
 alpha.kubernetes.io/nvidia-gpu:0


I am pretty sure I have 2 GPUs on the machines, with CUDA driver properly 
installed (I can see nvidia0, nvidia1, nvidiactl, nvidia-uvm under /dev).

I am in the middle of debugging this, but just want to check if anyone 
experiences something similar?

Regards,
Vu

On Sunday, December 4, 2016 at 10:38:51 AM UTC+1, Hui-Zhi Zhao wrote:
> Hi all,
> 
> 
> I have rebased #28216, any comment is welcome. Meanwhile, I will add more 
> logs and annotations.
> 
> 
> 
> 
> Regards,
> Hui-Zhi Zhao
> 
> 
> 
> On 30 Nov 2016, at 7:12 PM, Hui-Zhi Zhao  wrote:
> 
> 
> 
> Great! I am working on rebase my 
> pr(https://github.com/kubernetes/kubernetes/pull/28216).
> 
> 
> Regards,
> Hui-Zhi Zhao
> 
> 
> 
> On 30 Nov 2016, at 6:28 PM, Vishnu Kannan  wrote:
> 
> this

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2016-12-04 Thread Hui-Zhi Zhao 
Hi all,

I have rebased #28216 , 
any comment is welcome. Meanwhile, I will add more logs and annotations.


Regards,
Hui-Zhi Zhao

> On 30 Nov 2016, at 7:12 PM, Hui-Zhi Zhao  wrote:
> 
> Great! I am working on rebase my 
> pr(https://github.com/kubernetes/kubernetes/pull/28216 
> ).
> 
> Regards,
> Hui-Zhi Zhao
> 
>> On 30 Nov 2016, at 6:28 PM, Vishnu Kannan > > wrote:
>> 
>> this
> 

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2016-11-30 Thread Hui-Zhi Zhao 
Great! I am working on rebase my 
pr(https://github.com/kubernetes/kubernetes/pull/28216 
).

Regards,
Hui-Zhi Zhao

> On 30 Nov 2016, at 6:28 PM, Vishnu Kannan  wrote:
> 
> this

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

Re: [kubernetes-users] Current status of GPU support in Kubernetes

2016-11-30 Thread 
Kubernetes supports only 1 GPU as of now. Take a look at this doc

.
This PR  is attempting
to add support for multiple GPUs.
We hope to introduce alpha support for multiple GPUs in the next release
(v1.6).

On Wed, Nov 30, 2016 at 1:06 AM,  wrote:

> Hi everyone,
>
> We are considering using Kubernetes to manage batch jobs on an on-prem GPU
> cluster.
> However, I had a hard time looking for updated information about GPU
> support in Kubernetes.
>
> Here it said only 1 GPU per machine is supported:
> https://github.com/kubernetes/kubernetes/pull/24836
> Is it still the case?
>
> We have machines with several GPUs, and if the above information is
> correct then it would be a blocker for us.
>
> Thanks,
>
> --
> You received this message because you are subscribed to the Google Groups
> "Kubernetes user discussion and Q&A" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kubernetes-users+unsubscr...@googlegroups.com.
> To post to this group, send email to kubernetes-users@googlegroups.com.
> Visit this group at https://groups.google.com/group/kubernetes-users.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

[kubernetes-users] Current status of GPU support in Kubernetes

2016-11-30 Thread phvu225 
Hi everyone,

We are considering using Kubernetes to manage batch jobs on an on-prem GPU 
cluster. 
However, I had a hard time looking for updated information about GPU support in 
Kubernetes.

Here it said only 1 GPU per machine is supported: 
https://github.com/kubernetes/kubernetes/pull/24836
Is it still the case? 

We have machines with several GPUs, and if the above information is correct 
then it would be a blocker for us.

Thanks,

-- 
You received this message because you are subscribed to the Google Groups 
"Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to kubernetes-users+unsubscr...@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.