I started classes last week, and they take babies from 4 weeks, some classes are 6 weeks. It was fab, Ben loved it and didn't stop smiling throughout!!!
If you don't want to go to a class, just make sure you go easy, really gentle. I think any age is ok really, so long as you don't use any aromotherapy oils. Pure veg oil is meant to be good.