I'm sorry you were harassed for your diet. Really, there are many ways to eat healthfully. I hate when people act like only their way is the 'right' way. Honestly, I think that most people who make a conscious effort to research their diet and follow a plan are doing far, far better than those that don't. It seems like you both have looked into making the best decisions for your body.
I generally eat an organic diet of vegetables, fruit, and ethically raised meats. I don't tend to like grains very much. During my pregnancy I have been listening to my body and eating when my body tells me it wants. One weekend that meant an entire 4L jug of milk, which is definitely not normal, but I guess baby wanted calcium.

(Milk in Canada doesn't have growth hormones). Strangely, protein has been turning me off lately, and I have been wanting more grains. It's fine to eat grains as long as you know what's in them. Most bread that you get at the grocery store is loaded with additives, sugar, and dough conditioners, but you can find small bakeries that bake with organic, whole grain flour, and who use honey instead of processed sugar to make their food. It's not the grain (bread, cereal) that is unhealthy, but the additives and processed versions of these foods. Similarly, if you eat grass fed meat, and meat that isn't raised in abysmal conditions, you are getting a healthier animal, and a more rich nutrient profile. Animals that go to feed lots (which is most of your typical grocery store meat) have been fed a ton of low quality grain, so you are essentially eating it anyway, because your food is eating it. Also, just as a random side note, rice and wheat are processed differently by your body. Rice, especially wild rice, doesn't cause the same blood sugar spike that wheat does.
Anyway, from the articles I have read, most support the idea that genetics is mostly responsible for your baby's length. Still, anecdotally, when you look at cultures that adopt eating meat and milk, their children tend to grow taller over time. I am part Japanese, and when I went to live there for a few years, the difference in height between the children and adults was staggering, and their diet has become more laden with meat. Still, there is a higher incidence of growth hormone in animal products now as well, so it's hard to say if it's the protein or other factors causing it.
Be well ladies, and hopefully our nausea goes away!