It sounds like you were happier with the cheaper venue overall. I don't think you can choose one over the other just for the wow factor. After all you need to feel relaxed and happy on your big day!
I have had to settle for second best as the venue I would love to get married in is too expensive - they had a minimum spend, which was more than we had budgeted for. Realistically we could have chosen the more expensive venue, but it would have meant compromising on everything else. This way I can have all the little extras!
You could go back for a second viewing at both of the venues - it is a good idea to look at them straight after one another.
If you have a set budget, will choosing the more expensive venue mean you need to compromise elsewhere?