Have you tried Julia? Optimized Fortran (esp. on specialized hardware) would still beat it no question, but IMO Julia is a better value proposition for Fortran/C programmers than it is for Python/Matlab programmers at the moment.
I tried a bit. My problem with Julia at the moment is that it really wants to be the master and not be embedded, some work on the way[0] but the goal is more to become a general scientific language than a high performance language in which one can write some scientific code and hook it into something less "powerful" like Python.
Also, a very important point is that the code I write will be in use for the next 20 to 30 years. If a, proven over decades, reliable solution is available, it is better.