I am afraid that if I tell people I am studying psychology it will change peoples view of me?

Thinking of studying psychology but I also like my place in the world. I like to think I'm down to earth. When people here that I am interested in this area I fear it will make people sensitive in how they approach me and what they say to me. And also how they interpret what I say to them. Anyone understand this feeling? Does this feeling pass in time?