If you're using any of the Maya shaders then you might have to run your masking texture through a reverse node then plug that into the specular color. If you're using an mia_mat then just use the 'cutout opacity' channel under the advanced section.