Alternately, The problem may be that human labor is "cheap" for the activities which still require brick laying and in cases where it's "expensive" alternate materials can be used.

In order to make automation economically viable there would need to be a niche for "cheap" brick powered by automation. It's unclear to me that this niche exists and can't be similarly achieved by scaling up the blocks or switching to more labor efficient building materials.