ccu, Administrators
684
edits
Changes
Jump to navigation
Jump to search
m
→Acquiring GPUs with more than 20 GB
== Acquiring GPUs with more than 20 GB ==
By default, Kubernetes schedules GPU pods only on the smallest class of GPU with 20 GB of memory(nVidia Titan). The way how this is achieved is that nodes with higher grade GPUs are assigned a "node taint", which makes the node only available to pods which specify that they are "tolerant" against the taint.
So if your tasks for example requires a GPU with *exactly* 32 GB, you have to
spec:
nodeSelector:
gpumem: "4032"
tolerations:
- key: "gpumem"
