Computers are an existence proof - the universe is indeed at least a Turing machine.

The halting problem can be effectively solved for deterministic finite machines - it would just take a long time time.