Here you pay a deposit on bottles, no way around it. However you can return those bottles and get that deposit back. The deposit is usually 25 cents but can be anywhere between 5 and 25, depending on the bottle. You return them to a machine which crushes them and recycles. It then prints off a voucher which you can then use on your shopping or just get the money back. Very encouraging way of recycling bottles in my opinion. Some bottles don't have is option so you don't pay a deposit but most bottles have the deposit.
We do the same thing here in the US, but some states go by overall weight, so you have to collect enough to make it worthwhile. Pretty much all drink containers except for milk and booze have the deposit.
I have a collection of sports bottles and travel cups that I try to keep filled with ice and filtered water.