Do you just have a skeleton rig or do you have geometry attatched to the rig?

A pic would usefull .

Select the rogue vertices of that toe and check the weights in the component editor.