I have never tried but perhaps someone could come up with a useless_machine[0] type of webhook[1] such that a pull request would do nothing but close itself

[0] https://en.wikipedia.org/wiki/Useless_machine [1] https://developer.github.com/v3/activity/events/types/#pullr...