It is orienting reflex[1]. You car comes from a blind spot, triggers the reflex, they turn their heads. Then would return to a staring straight ahead, if they didn't noticed that you are staring at them. If they did they would look at your eyes to see any signs of what is it you want from them.
> I never did figure out how they knew.
Did you tried to figure out do they know that you are not looking at them? Would they look at you if you are not looking?
If I came up alongside them without looking at them they would not snap their head to look at me. Most of the time drivers do not look at the driver in the car next to them. However, if I came up alongside them while looking at them, most of the time they seemed to be able to sense they were being looked at and turn to look at me.
This article describes one situation of sensing when someone stares at you:
However, in the situation I describe, they are looking at the road ahead and not noticing me or where I might be looking. They seemed to be able to sense that I was looking at them before they even noticed that I was there.
If there is a movement in the corner of the eyes, like someone turning their head towards you, you can spot it subconsciously, or if you trained it a bit, consciously.
My gut tells me 1.) We are very good at recognising if something/someone is looking at us, 2.) Our peripheral vision is wider than we realise and information from it somehow goes straight to the unconscious mind.
That being said I don't think some sort of telepathic phenomenon happening here would be the strangest thing in this universe
> I never did figure out how they knew.
Did you tried to figure out do they know that you are not looking at them? Would they look at you if you are not looking?
[1] https://en.wikipedia.org/wiki/Orienting_response