There's a big difference between "done loading" and "appears to be done loading". Google is reportedly very cautious about the latter, and pulls some hijinks to appear faster than it is. Frankly, I'd be happier if more sites paid a similar level of attention.

That said, if your search page takes over a second, you're right, it might be an issue with your network.