If you don't want to be on hormones and it's a short time frame, only a couple months, I would use condoms or track your cycles and only have sex after you ovulate every month. Otherwise, I'd say use a copper coil, but I don't think many providers would be happy to insert it for only 2 months (and I wouldn't want to go through that hassle either if I wasn't looking for a long term solution).
Honestly though, I wouldn't shy away from staying on hormonal contraception until you're ready to TTC unless you have known fertility problems that you need to sort out in advance. I stayed on the pill right up to TTC both times and both times my cycles were totally normal the very first month. When I got pregnant with my daughter, I literally fell pregnant about 6 weeks after I took my last pill (2nd cycle). This time we don't know yet as it's the first month we're really trying (it's my 2nd cycle, but we didn't really try last month as I was traveling and then we were so busy with Christmas), but my cycles have been perfect. And I'm 36 and have been on the pill for 18 years now, except for when I came off it to get pregnant last time. If you know you have irregular cycles, then yes, I might give them time to sort themselves out. But if you have no reason to suspect you have any fertility issues, I'd probably not bother, stay on it til you're ready to TTC, and see if you can benefit from the fertility surge than some women get in the month or two after they stop. If you were to get it, no sense wasting it on a month or two when we're using condoms and not even TTC.