They're still not complying with the GPL though? It's completely cut and dried, it's not an argument where people can have differing opinions with varying degrees of validity. The GPL is a very well-known and widely understood license.
But if you stop infringing the GPL, the terms of the GPL no longer apply, so you cannot be forced to obey it's terms. You can however be sued for damages due to the historic copyright infringement.
