You can, but few do. The Stop sign makes sure you've come to a halt and are focused on what happens next instead of "just cruising".

Interruptions reset focus (unless you're so distracted that you don't notice the sign).