You should note that "owning" a property that you don't live in (or rent out) also requires the use of force -- state force to remove anybody attempting to actually use the space.
I suspect you're trying to make a pro-liberty / property rights point, in which case I think you should consider more carefully the basis of justified property ownership.
Even if you are inside it 100% of the time, it requires violence or the threat of violence to defend against trespassers that might just try to violently throw you out.
Violence is an inherent aspect of human affairs, so the question in every case isn’t whether violence is necessary but rather whether it’s justified.
I suspect you're trying to make a pro-liberty / property rights point, in which case I think you should consider more carefully the basis of justified property ownership.