Think about blind people. They can still know where things are, and project forward in time that if X, Y will likely happen. Neither spatial reasoning or causal reasoning are tied to visualisation. That's what it's like for me to think both about the past and the future. I can't even imagine why you'd need to visualise something to knowing where it is - it's such a total foreign idea to me.