I didn't realise the teet sizes had recommended ages for them either, opps! Joe is still using size 2 Avent ones and seems to be fine. As mum2b said, if he's happy then I'd stick with the ones you're using.
I might invest in some of the next size up though, just incase.
When did you go from size 3 to size 4 mum2b?