Ok I created an eye and made a rig for it, the controllers were working smoothly when using them for closing the eye and moving it around, but when I imported the eye in another scene where my character is, so that I can connect the eyes with my character, and when I did the connection, then when I tried to use the controls for the eyes to move them around they were lagging a lot, not sure why it happened like this when I connected them to my character.