I've had that too, with both DepoProvera shots and Provera tablets. I haven't yet found anything that stops them or get rids of them quickly!
I think provera also makes me feel a bit depressed for a few days after stopping taking it.
What are you taking progesterone for?