Your experience doesn’t describe mine. I don’t recall hearing any snide comments from people about my efforts, but I know that it’s a common problem.
Environmentalists get a bad rap because the most vocal of them talk down to people and demand more radical changes than most people are prepared to make. Hang in there and lead by example. Keep doing non-threatening things like using cloth bags and refusing plastic. Calmly explain why it matters. Your critics will notice.