This is anecdotal, and not explicitly about ATMs, but I have had those "Pay your bills here" machines at 7/11 and other convenience stores mishandle my money a couple times. It would report I paid $150 instead of $200, missing a single $50 note.

This was resolved after about 2 hours on the phone with the company who manages the machines, but I still don't use them anymore.