Though if one were to get fanwanky about it, one could talk about how the Master was first introduced in Three's era, and Three was inclined to wear cloaks. And since he stole the Doctor's TARDIS, he had access to the closet where past Doctors' clothes are known to be stashed.

In other words, is he stealing his ex-boyfriend's clothes?