It's not a simple supply versus demand curve. Sometimes adding a little more housing without flooding the market does end up increasing prices due to gentrification that changes the characteristics of a neighborhood.

Building more housing does "make the city suck" for people who prefer quiet, privacy, and unobstructed views. In some areas it probably makes sense to build regardless of their objections but that will have to be resolved through a democratic process.