Having been inside Google's data centers I agree with you :-). I did a top level, high efficiency data center design for a multi-tenant hosting with Google scale economics as an exercise once, talked with some potential partners who were very enthusiastic. It would cost roughly double what the existing warehouse type data centers cost to build, but it would repay its costs faster than they did (given colocation cost structures at the time). It also leveraged some of the open compute designs to achieve better density.