Yeah I think it's the robotic movements that really turn me off, or when the actors just look absent minded during the scene. For me that's Brad Banks. He's super hot, he has the build I go mad for, but he just looks bored in action.
I also get what you mean about Cameron Foster, though I've seen him perform okay with the right scene partner.