I'm really 50/50 with this issue myself too. I support freedom of choice for what's best for each mama and baby... but here is my experience...
I dragged myself through 3 weeks of trying in the beginning and had to stop too as my son has a severe tongue tie and can't latch so my supply just got so low and never really came in. The most I ever could get was like 3oz maybe. So I gave in and went to formula. I'm not devaluing breast milk or saying all the work isn't worth it, but it's not a horrible thing to formula feed though all the bottle washing is time consuming too. It's about equal I think to pumping.
My little guy is the healthiest baby... people always comment on his nice skin, hair, and the fact that he is big. Not fat though, lol. Just strong for his age and long.
Honestly, I know breast milk is wonderful for antibodies and stuff, but it doesn't mean that your baby will be sick or unhealthy if you give them formula.
Though I will be honest, I did have regrets so lately I've been trying to relactate with a pump (7 months later) but I'm remembering why it was so impossible lol. Pumping every 2-3 hours with a baby... uhm... yeah, hard lol. And with a newborn? Even harder. I don't know if it will work out for me but I feel it's worth one more try.
I would honestly try everything first. I wish I had known more before I quit. Like nipple shields, herbal tea, lactation consultant, etc. Also I just saw a good video about hand expressing with a special method that is supposedly almost as good as a hospital grade pump... though slower. If you will really regret stopping, I would say keep trying for a while until you feel like you've tried everything. It supposedly gets easier around the 2 month mark.
But if you really can't, relactation is something to consider in the future, especially if your baby is 4 months or under.
You can take a break if you absolutely have to. Though it's way harder that way. It does usually require a prescription or herbs which both do have some side effects, pumping every 2-3 hours day and night with a very good pump (I rented one), and can take a month for results.
And if you do stop and don't go back to it, don't let other people or mama guilt bring you down. Sometimes it's more important to have a bit more energy and time to spend with your LO to cuddle and play. I'm kinda figuring that out which cost me $80 (to rent the pump) lol. But I'm gonna try for another week and see how it goes.