I always sanitized my baby’s bottles, either via boiling water or via sanitizing steam bag.

But also, yes rinse them after washing them, also use a baby bottle detergent instead of "full strength" or whatever.

And then sterilise them.