It sounds like you have weighted those vertices to nothing. You need to keep each vertex weighted to something, even if you don't want it to deform; as if it's weighted to nothing, how does it know what it's supposed to follow?

Therefore, weight the offending vertices to your main head joint, and you should be fine.