especially hoods will look really silly if their details do not carry into the rest of the gear. Worst offenders in this mismatching are headgear.
where as metal armor all looks metal and it will all kind of blend together even if the pieces belong to different sets. On top of that cloth ussually has color, and therefor is very hard to mix with pieces of other sets of armor. Metal armor is much more uniform in its purpose. Wizard gear, or traditional sage/priest outfits were not meant to protect the wearer but to look extravagent, and match, in the old days.
Mage armor needs to look like you can move around in it easy, so it needs to be made out of cloth, so it will look like a dress.