Switching Sides in Comp

Explain to me the switching sides bit. My side won, then we switched sides, won again, and then... We got a defeat? Am I misunderstanding something? When you switch sides, are you supposed to do bad? Or am I just not getting it?