Exactly. Considering that Brahui is a Dravidian language, I always wondered how can regions so disjointed (Pakistan and South India separated by at least a few thousands of kilometres) have a common origin.
David McAlpin made a very strong case for Brahui *not* being a Dravidian language, but rather descended from the proto-elamite language family. He showed how Proto dravidian and Proto-elamite could have descended from the same parent language - he calls this Proto Zagrosian.
It's a very interesting take and I am personally convinced that he's on the right track.