I agree that this behaviour sounds quite serious. He has openly said he does not care about your mental or physical health. That is not right. He is supposed to be on paternity leave to take care of you and the baby and he is actually making things worse for you. Can you have a private talk with your health visitor? She may be able to get you some real life help (or perhaps kick him in the nuts for you)