I go to a mutual café every Tuesday for an hour or so. I don't feel comfortable with having FOB in my and my children's safe place, I don't want him coming in and making it a tense and stressful environment for them, when this is the one place they should always feel safe and secure.
It's working for now, but it's frustrating and awkward.
Also, just to add, he contributes nothing to our son. So for the contact, it's me whose worse off for it. But... it's worth it. I hope.