The existing settlements generally prove there's not much appetite for the substantial growth of random rural communities. There's a reason that Phoenix (and Tucson) exploded to become #5 in the nation, while hundreds/thousands of small communities remain pretty much as they were <back when>. The reason Patagonia isn't exploding is not nearby federal land ownership.