Nvidia drivers check if they are running in virtualized OS and refuse to install, if they detect it. You have to hide the hypervisor signature from the guest.

On top of that, virtualization of the GPU, instead of passthrough, requires support in the driver on the host. There is no such driver for Nvidia.