I did something similar and withdrew the end of the filament but left the roll in place. I fed the new colored filament into the material station nozzle (holding the new roll in my hand) and then the printer thought that it was the correct color. After it recognized it, I swapped the rolls.
It only performs the check once, so no need to swap labels. Just remember that it will be incorrect until you change that roll.