Only because they're not good enough at the moment: once it's indistinguishable from reality, they'll choose the path of lesser resistance that gives them the most control.
Let me put it this way: imagine the derision, scorn, and hatred heaped upon furries, /a/utists, Tumblrites, bronies, MMORPG addicts, and all other sorts of low-status netizens who are already perceived as overly escapist, and who thus get labeled "faggots" and beaten up for their lunch money. Now multiply it by a rather large quantity. In fact, you might have to outright square it.
That is how people are going to act towards those who deliberately cut themselves off from real life to spend time on VRs. There is going to be bullying among children and harassment among adults (but I repeat myself). There will be lawsuits and alarmist attempts at legislation.
Now, I don't really think either side of this coming dichotomy is healthy or correct. I think that escapism is fun, but it's not real life, but it is a strict subset of valid ways to spend real-life time. However, if your prediction bears out, that dichotomy is going to form.