And then your kid wants to use the computer but can't because you have the only CPU in your phone and you kick yourself for buying into the modular convergence snake oil.
If you were buying in to modularised hardware that worked that way then instead of buying your kid a tablet, they'd have a phone-style device.
It's more like you have a phone with thermal imaging built in, and your kid wants to use thermal imaging for a homework project, so now you can't use your phone.
Whereas with modularised hardware – like appification of hardware – then you'll be able to continue to use your phone (maybe to boost the processing capabilities of your desktop whilst you do a render or plugged in to your VR headset) and hand them the thermal imaging module to use with their processing device (be that a phone, laptop, or whatever).