Should I care what my neighbors think of me?

I don't fit the mold in my neighborhood. I am single and bought my home with cash in upscale yuppie neighborhood. A lot of neighbors think I am hired gardener.. I laugh at them because most are probably in hock up to their eyeballs. I just bought in the area to be in nice home and safe area but HATE the snob neighbors.