I don't necessarily think he's complaining about pot. I'm fairly certain that he is complaining about the fact that people go to smoke, whatever it is they may be smoking, and they take forever to come back. Only to repeat right away again.