> To continue with claims of no free will you end up needing to start appealing to some sort of a butterfly effect of environment.

The differences between the lives of even identical twins in the same environment are a lot more than a flap of a butterfly's wings. They don't spend every second of their lives together, so their experiences will differ quite a bit.