Anthropic has attributed Sonnet 3.5's model improvement to better training data.

"Which data specifically? Gerstenhaber wouldn’t disclose, but he implied that Claude 3.5 Sonnet draws much of its strength from these training sets."[0]

[0]https://techcrunch.com/2024/06/20/anthropic-claims-its-lates...