You're correct that we can only make out fine details in a narrow field of view, but that doesn't mean there isn't value to having more in our peripheral vision. Having extra horizontal width specifically is nice, because of how there is naturally more interesting stuff going on in that range; above and below you is just skybox and ground (for many first/third person 3d games), which you don't really need to see more of.