The greatest challenge when considering colors and accessibility is dealing with more than 2 colors. I wrote a tool to solve for all comparisons in a color scheme: https://github.com/prettydiff/colorContrast

In every real world scenario there will be a multitude of colors present that impact accessibility. It is almost never so simple as a single text color on a single background color.