Why not just make an ATX GPU with a CPU slot on it? With the size and cost of these things, it's the rest of the machine that feels like a peripheral and not the VGA.

The GPU is the main part of the machine by cost, weight, complexity, power consumption. And it's not even close.