I wouldn't be so sure about that. India is really complex. More than any country on earth. Sinhalese in Sri Lanka never colonized anyone as far as I'm aware, and since you have at least a dozen ethnicities across India, i wouldn't be surprised if some never colonized anyone.