If you are using Nightly (which updates twice a day), you can turn on "Show fewer update notification prompts" in your settings (about:preferences#general) which removes the update nag and puts a small reminder in the top right corner like you asked.