No more sex

So my boyfriend and I have been sexually active and he was my first and it took a lot with in me to finally give in physically ... Well lately I just haven't been feeling the whole physical part and I feel really bad because I feel like he's going to get frustrated .... Well I finally told him how I felt and we came to an agreement to lay off on the physical and try to work more on the emotional part of our relationship. Well now I feel so much better and I feel like a weight lifted off my chest because now I won't freak out every time after having sex if I'm pregnant ( yes we use condoms but I still worry ) .... Anyways so now I'm worried if I'm being selfish in not wanting to do anything physical... What do you ladies think or can anyone give me any advice ?