I remember this happening with my LO, to some extent I really do think it's normal. They feed constantly in order to bring more milk in, and eventually they don't get as much as they want when they want it and get frustrated. But the more they suckle (even if they're frustrated), the more milk you'll produce and eventually it won't be an issue.
You could contact a lactation consultant if you think it's a latch issue.