I have no strong feelings about them, don't find them more comfortable than any other shoe, and while I'll admit that can be rather ugly they aren't all that way.
The most common thing I hear against them are that they are "prison shoes" and so wearing them is like wearing orange jumpsuits. If it isn't wanting to avoid looking like a convict, it's that they leave blisters.