It's not that the in-falling particle is an anti-particle which annihilates with a particle inside the black hole. There are no particles inside the black hole, in theory, it's just a singularity. Instead it's that when one of the particle escapes, whether it's antimatter or not, the energy of that spontaneously created particle must be balanced out somewhere (conservation of energy), and that balance comes from the black hole.