Sex...?

I haven't been told we can't, and I want to... But it's really weird when the baby starts moving and I just feel like we're invading his space. We'll start off when he hasn't been moving and then I'll get a little kick. Anyone else weirded out/ feel bad about it?