How to Share NVIDIA GPUs with MIG, Time-Slicing, and Resource Quotas
TL;DR NVIDIA MIG and GPU time-slicing solve different utilization problems. MIG divides a supported physical GPU into hardware-backed instances with dedicated compute and memory resources. Time-slicing advertises multiple schedulable replicas of the same GPU, but those replicas still share memory, execution time, and the same fault domain. Use MIG when workloads need stronger isolation and … Read more