A different thread on here the other day seemed to come to the consensus that if you're considering an N100, you may as well go with a low end Ryzen. And for much the same reasoning being used here. Seems to be a little bit of a slippery slope.
If you or someone can find that thread I would find it an interesting read.
My cursory research indicates that a low end ryzen would make sense if you are building the board yourself. Right now, I haven’t found a new ryzen mini pc sub 200$. New N100 minis can be had for 150-175$, and if you don’t care so much about power N95 minis are even cheaper.