Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/21511
On Fri, Jun 8, 2018 at 10:36 AM, Ilan Filonenko <[email protected]>
wrote:
> *@ifilonenko* requested changes on this pull request.
>
> Thank you for this work. Would be nice to see some integration tests, but
> I don't believe GPUs are available in our test cluster. @shaneknapp
> <https://github.com/shaneknapp> to comment?
>
that is correct -- we currently have no GPUs in the cluster.
that being said, we do have plan to add one or two GPUs in the near future
but they (initially) will be reserved for riselab-specific builds. the two
big problems that we have when it comes to deploying them are:
1) 8 of the 10 build nodes are blade-style servers (4 servers in a 2u
mount) and don't have physical room. the only two we have that can
physically house them are the current amp-jenkins-staging-worker nodes, and
they can hold 2 each... but due to how the power cables plug in on most of
them, we are again limited to a couple of specific GPU types (power cables
on the top of the card vs being on the back).
2) GPUs are expensive... :)
i'm more than happy to revisit k8s tests running w/GPUs once we get them
installed in to the workers and figure out our lab's usage stats.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
