Medieval Plate Armor: How Invulnerable? Why Leave It Off?

There is an impression that full late-medieval plate harness makes the wearer practically invulnerable. So why did some fully armored 'knights' and men-at-arms decide to reduce their level of armor sometimes?