As a sibling comment expresses, it’s their unshaded nature. The light is too direct/harsh and can introduce glare. They can also wind up in peripheral vision easily, particularly when sitting down and looking up at someone standing or at an object high on the wall.

Indirect/shaded lamps that diffuse the light over a larger area and reduce its intensity are preferable.