Lemon juice and toothpaste are known for drying them up.
When I had googled for something like that, I found that most women were told not to have anything like salicylic acid or benzoyl peroxide left on their skin. It was likely okay as a wash since you rinse it off, but not as a cream left on the skin.
It probably depends on how cautious you want to be.