~6 weeks along insulation exposure?

[futuremama88]

About 6 weeks along, and husband accidentally drilled into a wall which must have had insulation behind it... soft puffy stuff puffed into his face and he had problems breathing... I'm guessing it was insulation. The home is 8 years old. I'm guessing it went into the air, though we cleaned up the insulation and dust. Put duct tape over the hole that to hopefully prevent any more insulation dust from coming out. I was in another room when it happened but I'm guessing it's in the air now. Hazard for baby? What should I do now? I am googling like a madwoman but not finding anything. Thanks!!