Yes it's not like solar panels are condensed out of the air with zero waste. They have to be manufactured, in a process which almost certainly isn't carbon neutral yet. The materials used to make them have to be extracted from somewhere. They're transported to the installation site on the back of diesel-burning trucks.

Cleaner energy sources are a necessity, but simply reducing consumption will always have the best impact on sustainability.