This was my biggest problem with getting pregnant (hence the username!!) I used to drink 6 or 7 mugs a day, all from a pint-sized mug too! So have had to majorly cut down. There is less caffeine in tea than coffee, so you can have 3 normal size mugs of tea in a day with no problem, if that's all the caffeine you're having. The problem with it is that the caffeine crosses the placenta unchanged, so the baby gets it too!
One thing I'd mention that others haven't is Coca-Cola - one can has as much caffeine in it as a mug of coffee!! So be careful there too!
And I agree with the decaf thing too - espec if you buy a decent brand of tea, then the decaf ones are ok (I get Yorkshire Tea ones, they're virtually the same as the regular)
x