back

by apitman·1mo ago·view on hn ↗
My favorite microVM discovery recently has been tools built around libkrun. See smolvm[0].

The killer feature still missing from microVMs for me is the ability to enable CUDA support without passing through the entire GPU. vfio is just too much of a pain and too limiting. Sometimes I want to use my GPU on the host. Vulkan works fairly well with virtio-gpu and Venus, but I need CUDA. Venus is also still missing some important things like accelerated video encoding.

[0]: https://smolmachines.com/

1 comments
author of smolmachines here,

CUDA support is possible based on a cursory dive. I'll keep you posted on it

ref: https://thevirtualhorizon.com/2024/05/31/how-to-configure-th...

I think the main blocker is on nvidia's side, which is that vGPU is only available for enterprise customers/products.