Masking a decal by its alpha channel ensures adjustments (for example, roughness changes) apply only to the visible portion of the decal, not the transparent background.

First, create a decal in your Asset Texturing project. Then, add a layer reference to the decal layer.
Add Reference button below the Layer Stack to create a layer reference for the decal.To learn more about how to create decals in InstaMAT Studio, please read our dedicated article on Decals.
Next, create a group and use a reference generator mask that targets the decal reference's alpha channel information.
Layer Stack, select the decal’s Multi-Channel Layer again.Add New Layer Group button to place the decal into a new layer group.Layer Stack.Add Mask button and choose Reference Generator.Source Reference dropdown to select the decal layer’s reference.Generator dropdown to select the BaseColor channel.Histogram widget, click A to target the reference’s alpha channel.Everything in the layer group is now masked by the decal’s alpha channel. Additional layers added inside the group affect only the visible area of the decal.
To learn more about references, please visit our dedicated article on Layer References.