Try adding a layer of b/w noise. You can make a specular map. It's just like the bump map in how it works: white areas has spec, black doesn't.