You can't delete edge that define the border of an object. Pretty much anything else on the mesh surface if fair game. You can increase the border edge display in preferences if you want to quickly see if an edge is a border edge or not.
AIM: mhcannonDMC
"If you love your job, you'll never work another day in your life."