Birth control and sex

Recently I had taken my iud out and got back on birth control. My doctor told me to wait a month before having unprotected sex to let the birth control get used to my body. (I’ve been with the same man for four years). We stopped using condoms a looong time ago. So we waited..

The month is over and I’m going crazy. Has anyone had to do this? Should I wait longer? Or just listen to what my doctor said??