I don't see why not. In fact, it would be "cheaper" for them because they do not need to pay the value added tax to your non-EU company. Sure they'd get that eventually back from the tax office if they were paying just another Finnish company, but it would still take a bit of time.

I think Finnish clients can work with an American LLC. I'm not 100% sure, but I can't seem to even imagine why not.