You have to differ between mountain biking and downhill biking in a park, though. The latter is far more extreme with big jumps etc.

For me, I feel "safer" doing something where I'm in control, compared to when I road bike and my life depends on the whims of an angry driver passing too close. Even if the risk might be bigger in the end. Something about known risks you can control vs not.