That's why you put your hands on the steering wheel. The officer walks up to the car, sees your hands, sees your wallet on the dash and puts 2+2 together.

Otherwise, when you reach behind your back for your wallet, the officer has no idea what's going to be in your hand when it reappears.