Mine went up to 36.7-37.3 after I ovulated the cycle I got pregnant. It went down a bit after a few days, then shot up the next day which is what led me to POAS...
I did take my temp a few times after getting my BFP - one day it was up to 37.9 which worried me a bit but I think I was a bit ill too. Otherwise it's generally been above 37. I did start to panic at one point when it went down to 36.7 again, since I'd read falling BBT can indicate a miscarriage, but all the evidence I saw said that temperatures fluctuate lots in pregnant women so not to read too much into it - it's not reliable at all.
I wouldn't worry unless you go above 38 (when I think it begins to be classed as a fever) or you start to feel like you're running a fever. Everyone's different.
xx