I've tried that too. But I work from home and not having the ability to use Banking apps on AOSP without a ton of patching and hacks that could fail anytime afterwards is an issue. Also the camera performance on AOSP is noticeably worse in my experience, and I'm not alone.
To make AOSP "usable" for my life, I need to install the Play Store. At which point I've already lost and would prefer an iPhone for my privacy.