I'm trying to model a square hole in a cylinder.. so I simply extrude the face in and when I press 3 it shrinks in to bad shape holes. So I fix that by add a support loop like in the pictures. But I have some edge appears which is not suppose to be there Is there anyway to get rid of it? (picture 3)
Thank you everyone!

