I want to have sex but i don't..

Me and my boyfriend have been dating a month now, but we have close friends before for 5 months. He was always there for me when i needed someone to talk to. We have talked about sex now and i'm honestly just scared of getting pregnant, or him ending up not being who i've known him to be and leaving me after we do it. Im a virgin and so is he. I know he is just waiting for me to be ready, and i keep thinking i am and then i change my mind, and i feel like he is probably getting really annoyed. I want to do it, but i'm not on birth control and we would only be using a condom. Maybe if i wore a condom too it would be better and lessen my scare? Please help, any advice is helpful.