Velocity is based on calculating exact numbers from wild ass guesses. Estimating story points is not an exact science; implementing things you've never done before adds more variability; pressure to go faster creates mistakes that take time to repair; then add everyone on the team up and call it team velocity. The average of 100 coin flips is likely close to 50% heads, the average time to drive across the country is unlikely to converge on anything useful.