Advances in semiconductor fabrication are no longer increasing single-threaded performance of general purpose CPU code very much. It's still possible to increase performance by orders of magnitude, but it requires giving up flexibility by using dedicated hardware acceleration blocks such as tensor cores, plus going massively parallel with various combinations of SIMD and threading. That all makes software immensely more complex and less portable.