On your left hand period (with unused rings been worn on the right) unless the character has no left hand in which they are worn on their only hand.

They cannot be switched during battles, once a battle is entered into the upgrades are set until the battle is won, lost or forfeit. At any other time they can be switched, so if you have many upgrades it is good to make sure you have them all set before a battle starts.