There are certainly segments of this population that can afford to pay back a loan. Or there is a loan that can be structured so that this segment of customer can pay it back. Its just not profitable or efficient for a bank to lend in this segment as a whole currently.
This leads to a segment of the population (usually lower income, but not always) without broad access to credit or leverage.