I understand! Before my first I had lost 40lb (college weight!) and was really enjoying the new skinny me...but after a while I has to realize it was the first of many things I was willing to give up for my little man. In the end, I also gave up my sleep, warm meals, sanity....lol.
I gained a fair amount (I think 35lb) but really had no problem losing it. You have to remember the healthy habits you learned to lose that weight in the first place haven't gone away. So once you have your body back to yourself, you can go back to those healthy habits and you'll be fine!
Side note- unlike celebrities, I didn't get my body back for a few months. Between a disasterous breast feeding experience, LO having acid reflux and colic nature, and my postpartum depression, it was about five months before I even gave a hoot how I looked. But we all come around eventually. Just don't stress yourself over a timeframe!