I would definitely be upset. Just keep in mind that men don't think like us and don't always understand the way we think any more than we always understand the way they think. Try talking to him openly and honestly, but lovingly. Chances are he won't even be open to the idea if you start hammering into him for being insensitive or something like that.
I don't know about your man, but my husband is very practical and doesn't see any point in doing anything unless he sees a concrete reason why he should. If he thought he'd be going with me to look at a blank screen he probably wouldn't want to go either. That wouldn't be him being insensitive, or unexcited, or detached, just practical.
Granted, we haven't ever lost a baby, and we've not been married long at all, but my limited experience says it would be best for you to talk to him about how you feel about his actions and ask him to with you. But lovingly and respectfully is key. Try putting yourself in his shoes (not that I could IMAGINE not wanting to go to a scan in his situation, but that's not the point). Put yourself in his shoes and imagine how you'd want him to come to you. Lovingly and respectfully, I'd imagine. You may just find that like the other ladies have suggested, he's just as scared of losing this baby as you are.