Race generally doesn't matter. The problem is, society at large puts emphasis on the attractiveness of one race versus all others, which leads to an overwhelming number of people who want to date that race, perhaps to the exclusion of all others. This unfair advantage is what minority gay men complain about, especially gay black men, who have the disadvantage of having the exact opposite features of what's considered by society to be most attractive.