I've been on ProActiv for about 2 weeks & am seeing a little bit of results but my skin is severly dry. Help?

I'm 15 and this is the for the past year I've been getting acne, - my first time ever. I've tired pretty much everything from aloe and went on Clarins for about a month. Clarins is rather expensive so when I finished up the small container of Lotus Oil (what gets rid of the acne) I didn't want to spend $50 every month. So instead a few months later I decided to buy the 5 piece ProActiv system. I have been using that for a little less than 2 weeks and it seems to be working ... somewhat. I have very soft skin which is sensitive to some products. At first my face would go very red when I used it, but it doesn't go that red anymore. However, my skin is ridiculously dry. It's flaking and peeling everywhere and I am sick of it. I just want clear skin. Do you think that if I stopped using Acne "treating" products, and wore no makeup or anything on my face, the acne will reduce and go away on its own? I did some investigating on Benzoyl Peroxide and some people say it causes premature aging (something which clearly don't want to happen). I'm at the my lowest point right now and miss the skin I had a year ago. I literally don't know what I'm supposed to do.