Was I too rough on this guy?

What you said about your friend Pete is amazing. Your parents did an excellent job raising you. Congrats- I think you did the right thing, telling him off. People should never be judged by their physical appearance, ever, and should be treated equally. Respect, yeah, that should go up or down depending on behavior, character, etc.