As an IC you can't tell other teams managers or higher ups or PMs to fuck off if they call you directly and tell you they think what you are doing isn't good. Or if they ask for unreasonable stuff. At least without fear of getting fired. A manager needs to prevent this from happening