I buy the higher end Apple products not because I plan to use all their power immediately, but because I keep my devices a very long time and want them to retain usability right to the end.
Is it, tough? I feel like everything on my M1 is still as snappy as it was on day 1. My previous MacBook definitely showed it's game after 4 years, but I'm happy to use this one for at least another 2-4.
Mine is an M1 Max and gives me no gripes after four years. Like you, I also felt as though past laptops felt their age sooner. I'm typically using Photoshop, Lightroom, Resolve, Docker and other usual stuff at any given time.