Supplementing with formula probably hindered that, but you can't let the little man starve.
Have you talked with local LC's at all? Please don't be discouraged about the amount you're pumping. In the beginning it won't be much at all, and certainly not as much as the LO can take.
I can only give my personal experience, but here's an example: My first DD was born blue and ended up in a NICU in spite of her 38 week gestation and her massive size (12lbs plus). They drove her two hours away from me, and I followed 15 hours after nearly bleeding to death with her. Due to her various issues (related to birth trauma) they did not feed her AT ALL the first several days. They had her on lots of bags, including a banana bag. (vitamins) I pumped my ever-loving heart out, discouraged by only getting drops at a time. They assured me this was natural, and had me pumping round the clock on a two hour schedule. I did not vary from it once. Beyond that, they did not throw away my little drops - they saved every single one! This of course ended up being my colostrum, and they would end up putting it through a tube in her nose down into her tummy. When we were allowed to try to breastfeed they told me it would take weeks and to combi-feed her with formula until then. I took her home, and she wouldn't wake up at all. She was not used to being hungry before a feed, so seems she didn't know how to wake up. I was terrified! I called LLL and was instructed to stop giving her formula no matter what, and to put her to breast very often. They also taught me how to rouse her for feeds, so that is what I did. She was EBF within 24 hours. That is not for everyone, but I needed help and got it. I did still end up running out of milk in the 9th month (due to feeding her too soon - I didn't know that cereals and purees are not necessary as everyone likes to teach), but we had - I believe - a good run.
Second baby I had a cesarean, and took her to breast as soon as I was set up in the recovery room. Getting to meet my baby and stay in the same place as her was a dream come true. She lost over a pound of weight, and became lightly jaundiced but the nursing staff is pro-nursing and let me go with my instincts instead of forcing anything on either of us. I put her on the breast constantly, and she pinked back up and was able to come home.
Why am I sharing these? Because with the first DD I pumped SO much and ended up having massive amounts in the bottles (I was very proud of this) I expected the same thing with my current LO. This has not been the case. To this day if I pump for her I can mostly get around 1/2oz from both breasts - 2oz at the very most (again, both breasts combined). I can get 3 if I've had fenugreek and pump instead of nurse. But like I said, mostly I only get around a 1/2 ounce. I've all but given up at it, actually.
So please don't be too discouraged at the amount you are pumping. I think you are smart to get a supplement and ask for help. Breastfeeding is a lot more work for some of us than others. (All three of my sisters could be nurse maids.) It is work that is worth it, though. Finding someone you can talk to locally is a really good idea. That said, I'm very grateful for Baby and Bump because it is also a good source of support. I wish I'd had something like it seven years ago! I might not have had to stop so early!
Formula definitely puts a dent in what we can do, so in your case I would always, always offer the breast first. Letting your baby suckle will stimulate production, and whether or not your breasts respond to the pump, baby will get more as time goes on. Even the crying helps, oddly enough. You can always go to formula after if you have to, but definitely put time into trying to keep up the breastfeeding.
Genetics may or may not play a roll, I'm not sure. I would say though, that we have more resources today than either your mother or grandmother did. Don't let it get into your head that this trouble has to happen or is the end of your nursing experience. With work and real guidance you should be able to build supply and wean off of the formula.