Probably the biggest difference is that Designer is a combo of a raster and a vector editor, while Inkscape is a pure vector editor. Also Affinity suite supports more color spaces, like CMYK for print stuff. Affinity apps are also very well optimized for Mac and M1, while Inkscape I hear is not.
But there’s probably many reasons against choosing Designer over Inkscape too.