That should be a fairly deep rooted memory. If you're having difficulty recalling, that is concerning. I respectfully urge you to consult with a neurologist or at least your GP.
I'm still pretty young and have had a somewhat robust love life. I sometimes wonder if I am not just audiating the brains internal lookup of the information anyway. If I am focusing then name recal is normal thankfully!