Does science fiction exists? Or Pokemon? In case your view is that they don't, you may argue similarly that math is a human made construct (which happen to work well to describe our universe, but it may be just survivorship bias as we use in physics only the math that works. For instance we discard imaginary solutions to classical motion equations).
I do believe it is the right view, math is a man made "language" inspired by physics which is more fundamental.