I have a whole-home water filter, and fill up a jug from the tap that sits inside my fridge until I'm thirsty.
I have never understood why people take extra steps, have extra inconvenience, and have more expensive, harder to replace items just for the sake of saving, what, fifteen seconds filling up a pitcher?
You can probably find some tape that matches the color nicely on Amazon for a very small amount of money.