From the point of view of the employer, it does not matter too much that you personally dislike remote work. Their negotiating position is based on the fact that other people think it is a perk, so because of the tradeoff between fun and wages[1], they can find a replacement just a little bit easier than if the position was not remote.

[1] https://www.mruniversity.com/courses/principles-economics-mi...