Bench assembly of cam tower to heads - any downsides?

[VFR750]

Are there any risks with bolting the cam towers to the cylinder heads on a workbench ahead of engine assembly?

Seems the dowel pins force alignment between the individual heads. And we typically torque the cam tower nuts before we torque the cylinder head stud nuts.

Taking the heads off as a unit and reinstalling as a unit is ok too. Done that, no issues.

So is there anything I'm missing?

[Flat6pac]

I have always done it as a unit. It's way easier than trying to line up 6 studs and 2 pins on installed heads.
Last few years I've been doing them as complete assemblies
Bruce

[john walker's workshop]

Complete with cams and all the rockers. Way easier. Having all the rockers in will hold the cam in place as you pull the pin to set cam timing rather than having it flop sideways with only 1 and 4 intake rockers installed, as recommended elsewhere.