I like cats, but as a normal animal, wandering around like I do too actually, a silent and mutual respect, I can touch him if he wants, or just let him smell me, but surely not going to harass him, or worse imprison him

The love you're talking about is based on food, stop feeding him and open an exit, and see for how long he'll stay.

That's a bit like saying a wife is loving me, but I have to buy her lots of things continually, this kind of love would suck no?