I suggest using geometry for image planes rather than camera-oriented ones. Then you CAN just rotate them.