Typically you're not supposed to swallow toothpaste or mouth rinses, so relatively little actually stays in your body. Tap water is generally considered fine to swallow in large amounts though.
A lot of medicines are taken sublingually, because absorption is expected to be higher than through the oral route. Does fluoride not get absorbed that way?