Because a single PE teacher can manage five rotating classes of twenty kids throughout the day. If kids didn't rotate periods, then all 100 kids would take PE at the same time. That would require extra PE teachers, because one teacher cannot manage 100 kids. Multiply this effect by every different area (music teachers, art teachers, etc.) and you have to hire a bunch of extra teachers which is a waste of money. Plus, those teachers would only be busy for part of the day, so their wasting a lot of their time.
These specialized teachers are non-existent in many schools. You may have a PE teacher, but they may or may not already be full time. Art teacher? LOL
Many school districts around the country are far too broken to worry about start times. The republicans have done a very good job of starving education for money over the last 20 years, and rampant corruption within the teachers unions and school/district administrations doesn’t help the situation.