I'm willing to bet that the moisturizer you are currently using is not formulated for oily skin or has some overly emoilliant ingredient. If you do discontinue to use it, chances are it will help. BUT if you are using anything at all to help the acne/oil, than you need something to prevent transepidermal water loss- basically, dehydration of the skin. That doesn't mean you will be retaining more oil, you will just be maintaining the neccessary water moisture needed in healthy skin.

An esthetician