You don't need fresh on all the time, but for long trips I will switch to fresh for at least five minutes each hour. You just want to cycle the air in the cabin for less re-breathed air.
This is almost certainly correct. An unventilated space as small as a car will increase within 30-60 seconds, based on my testing of small indoor rooms.