Pretty much the same here, couple of beers and a couple of whiskies most evenings. I smoke about 15 - 20/day too. I used to smoke a lot of weed when I was younger but these days, just now and then. I think all of the above have affected my EQ and sex drive to an extent, probably weed the most. I've got a pretty stressful job and to be honest, stress has the worst affect on everything, but the bad habits don't help.
I'm planning on cutting them all out this year and getting fitter and healthier again. Only saving grace is that I have a good diet, no fast food and always cook meals for myself with fresh ingredients. Too early to say whether the bas habits will affect gains, but they definitely make me less horny than I used to be (which probably suggests they will).