Hiya I use these too and u r right u can't warm up in water as theyvhave air holes at the bottom, they are great bottles though..
I warm up milk in a different bottle or container (mug in the microwave at mo) and transfer to the mam one when ready, my LO is much older though so don't need to worry about sterility so much..
Not sure if that helps much! Good luck xx