You can but when you wear it on the wrong side, the buckles will be the other way round, so the bit you pull to adjust the length of the straps will be inside rather than outside. It doesn't make much difference though. If you want to see what I mean, have a look at the buckle on a backpack or something.