That's just how context works. If you're going to backpedal, go back in the conversation and edit your prompt or start a new session. I'll frequently ask for options, get them, then edit that prompt and just tell it to do whatever I decided on.