Why do people look down so severely on those who use marijuana?

To be honest I don't look at all marijuana smokers as losers. I would be interested to compare education, income and generall health between users and non users though. I think the fact that most users have different values than general society can sometimes created a looking down effect. Also just the fact that most people are brought up with the label of pot users being bad, lazy, etc...