How are you switching views? If you hit space to go from your camera1 to a four view for example, and then hit space to go back, it shouldn't change.