i know this is an old thread but i rarely see this discussed despite how common this feeling is among gay men.
i am the same OP. anal is painful if you're tight, which is the case for most people. that's perfectly and anatomically normal, even expected. i prefer taking average dicks too, even though it's nice to admire a big dick or even suck one (but even then i still overall prefer to suck an average dick so i can deep throat the guy!)