This might be the case for Windows, but with Linux, most drivers are already distributed with the kernel and can be dynamically loaded and unloaded depending on what hardware is discovered while booting or afterwards.