Chromosomal sex is established at conception but physical differentiation occurs later. The idea that all humans start as female is mistaken. It stems from the observation that in the absence of male specific signals embryos will follow a developmental pathway that results in female characteristics. But biologically speaking embryos are not inherently female. They start in an undifferentiated "bipotential" state.