To build, you need permitting. To get a permit, you need permission from the municipality. If the neighbors believe they will be adversely affected by the new building, they may petition the municipality to reject the new building or make them alter the plan, at which point it becomes a political issue, not a private home life issue.