This phresh filter which I use on my intake claims to be able to filter pollen... although I don't have actual evidence:
You could consider a small carbon scrubber. This will eliminate the smoked smell from getting out of your apartment. Depending on how big the room you normally smoke is, will depend what size carbon filter you will need. With the fan to run it, will cost you about ~$180 for a bedroom or small living room.
I know not cheap, but there will literally be no smell in the room 20 minutes after you have smoked. And smell will never make it out of that room.
The fan will last 5+ years, but the filter will need to be replaced every few years.
This filter would be perfect, for a bigger room maybe go to the 6x20" size (they make other sizes not listed in this amazon link), or whatever one they make near that.
http://www.amazon.com/Phresh-701265-Intake-Filter-12-Inch/dp/B007ZU748Y/
For fan, the Cap Valuline 6", or Hurricane 6" fan will work fine.
edit: if this is too "ugly" for you or your family. A Honeywell type HEPA filter with carbon will also work, however the amount of carbon they use is very minimal compared to what I linked, and will need replacing every few months. However you are going to pay a premium for the HEPA filter part of it. And that part will not do anything for smoke odors.
If you are a DIY'er you can make your own also, but its almost not worth it because its very hard to pack the carbon without a paint shaker type machine. So it doesnt end up being nearly as efficient at removing smells.
Also Ozium original scent works pretty well for masking the smell in the meantime. During Spring, Summer and fall. If you get a window fan blowing out and make sure there is negative pressure in your apartment, this should suffice. The negative pressure part is key to that plan working.