Sex during pregnancy...

Ok so I know my doctors said it's fine, that the baby won't be hurt or feel anything but maybe bouncing, but I can literally feel his thing bumping into the baby's sac and it feels so weird. Is this normal?