Nope, tokens can be transferred to and from anyone. All you need is the other party’s unique wallet address.