yes you can! that is what i do! i started alexa on rice cereal two days ago, and have done both, mixing it with water, and mixing it with breast milk. she likes it better with breast milk. i have tasted both for heat test, and it tastes a lot better with breast milk.