The Sun transfers orders of magnitude more heat to your body than cell towers or your phone.
The problem with every argument about radiation from cell phones being dangerous is that for every proposed mechanism, the Sun is orders of magnitude more damaging.
The obvious worries with cell phones are repeated stress injuries, insomnia and disruption of personal relationships. There's just no plausible mechanism for the radiation to be damaging, though.
A simple power comparison is not a great measure of affect.