Coming off Birth Control

My boyfriend and I have decided to stop birth control and start trying for a baby. We both discussed this over the course of months and he was the one who finally decided I should quit birth control. But now that I’ve stopped it, our sex life has changed. My sex drive is low and when we do have sex, he isn’t finishing inside of me anymore which he used to. Should I be worried? How can we fix this?