Deaf and Color Blind

Today some customers asked me to get a pot for them, and I asked "the red one?" Then I realized that it was brown so I said "I guess it is brown." and she and her friend said that I didn't see colors well because I was a guy. Then I remarked about her purple watch, which was really red, so they really started making fun of me for being bad at colors. When I said that I corrected myself with the brown pots, they said that they didn't hear me "because you talk quietly." I responded by saying that I have exceptional hearing so I think I am talking louder than I am. Then the one customer thought I stole her watch. I have no idea why they let me work with the public.