I think it is harder with your first baby, your world changes completely.
I remember thinking with Ivy that me and my OH would be divorced by the time she was 1, it felt like there was no closeness, no time for each other. We were fine though, gradually we got time back to ourselves and we both adapted to our lives being different.
Even this time we both get frustrated and want some more time for each other but it is no where near as bad.
Everyone makes mistakes - put the carseat in really badly wrong the other day, Elodie has also put blankets over her face, she has fallen over from being propped on the sofa, Ivy has rammed a toy bottle in her mouth when I should have been watching etc etc!