If you're in a relationship and it bothers your partner, you can experiment with shaving.
For random strangers, don't worry about it! They've seen it before (especially if you are in the Middle East).
Also, I don't think most people care much, unless they are checking you out. And if they are checking you out, there are plenty of us bear lovers who like to see that. ;D