I believe where test-taker bots fail is if the question assumes human experience or "common sense". If the question starts out, "If you eat half of an apple...", the bot won't naturally understand "eat" in terms of what it does to an apple. It has to be programmed with some kind of model or heuristics for eating ahead of time.