It's not so much that it's highly radioactive as it is that radiation detectors are really sensitive. It's not inert, but its specific activity is pretty low. The types of radiation it emits do mean it is significantly more dangerous if you breathe it (say as dust) or otherwise absorb it into your body.