sunflower, noone should ever threaten to physically harm you.
if he touches you, call the police immediately.
if you do not feel safe, you need to take your daughter with you, and possibly spend the night at a friend's, neighbor's, or family's house.
he might not have meant what he said, but it does not matter - he said it, and you no longer feel safe.
i would never recommend saying things about your husband's family - that's his family, and whether or not it's true, that's still his family. it doesn't give him an excuse for what he said, but remember, if you don't want someone to say things about your family, do not say things about theirs.
stay safe!!