That's not universally true. Most of the contractors I know are a mixture of PAYE and dividend (pension requirements don't apply to directors and paying nominal NI secures a state pension on retirement). It's usually the setup a good accountant will suggest.