Can anybody else relate?

My boyfriend and I have been together for 4, almost 5, months now. I fell hard and fast and so did he. We talk about our future together all of the time and that makes me really happy. The only problem is I come from a very religious background, no sex before marriage, no living with the opposite sex unless they are family or you are married, etc... He was not raised in church so he doesn't really have a grid for the battle that wages inside of me sometimes. When I am with him sex doesn't feel wrong and I can talk to him about moving in together in the future. But, when I am home I begin to feel guilty and ashamed for what I have done because of my religious upbringing. Can anyone else relate?