Pure_morning is right. I think what you guys are missing is moving the object's pivot point first.

Create your sphere and hit the 'insert' key. Move the pivot to the point where you want to duplicate the spheres around (from the image, right in the center (0,0,0). Hit the 'insert' key again. Now, do your duplicate/rotate and it should work.