Wikipedia claims that "Some states, including California, Hawaii, Maryland, New York, and Oregon, have banned chlorpyrifos on food grown and sold in their jurisdictions. Those bans remain in effect." It's also 100% banned in foods sold in EU area.
So, not that hard to avoid depending on where you live. Apparently corn, soybeans, wheat, fruit trees are some of the most common crops it's used on.
If it’s banned in all those places, does that have a knock-on effect of limiting its profitability thereby causing the market to produce less of it to sell elsewhere?
This specific pesticide might not be used on organic crops, but plenty of other even-less-well-safety-tested "organic pesticides" may be used instead on organic crops.
The word "organic" is largely a marketing gimmick.
While organic might currently be a "marketing gimmick" purchasing organic is an important signal to the market that consumers consider it important. I'll gladly be a first adopter if it helps move the industry and regulations in the right direction.