I don't like it because it is used in oppression olympics. It is used by people to erase the struggles and discrimination other minority groups face. It implies that these minorities have the same privileges of straight white men which simply isn't true.
Also I wouldn't label a person who is transitioning or has done as a "trans-man" or "trans-woman" they would simply be a man or a woman.