I think it would also have to be at an equinox. Otherwise the pole would be tilted towards or away from the sun, meaning that it orbits at a slightly different velocity, so you would have some velocity relative to the center of mass.