IMHO patchouli smells like a filthy, weed smokin' hippie.

"Filthy" as in not very clean, weed smokin' as in "smoking marijuana" & hippie as, well, hippie.
Seriously, I really do tend to associate it with weed, mostly because that's the incense that all the pothead friends used back in the day (& some still). I have NEVER liked it & never will. Not because they were bad people or anything, I just don't dig the smell. It makes me gag.
Yet my friend Heather, who is not a filthy, weed smokin' hippie, loves it & wears it all the time. When she does I stand upwind of her.
It really is hard to describe. There's plenty of incense & candles in most stores that you can check on the smell, but it's really one of those things that really is it's own scent.