It absolutely makes sense! Our doctor told us to wait until after I had my first AF, so that if we did get pregnant right away it would be easier for them to figure out how far along I am. We did that and have been trying really hard until yesterday (and I'm ovulating about now too). I had a little meltdown last night, realizing that I'm not quite as "fine" as I had thought I was. I'm pretty sure that we didn't get pregnant this month (although I won't know for sure for almost two weeks!). Surprisingly, that doesn't seem to bother me much this month, whereas last month I was super upset. Like you, I'm scared about what will happen next time. And, since my last miscarriage was at 17 weeks, I've got a long time to worry about whether everything is okay.
I think you and your OH need to do what's right for you. If you feel ready now and think you'd be okay if you got pregnant again right away, then go for it. Otherwise, take some time for you. It'll happen eventually. I know it.